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RELATIONAL  PROGRAMMING 


L  Introduction 

In  this  report1  we  discuss  relational  programming,  i.e.  a  style  of  programming  in 
which  entire  relations  are  manipulated  rather  than  individual  data.  This  is  analogous 
to  functional  programming  [Backus78],  wherein  entire  functions  are  the  values  mani¬ 
pulated  by  the  operators.  We  will  see  that  relational  programming  subsumes  functional 
programming  because  every  function  is  also  a  relation.  It  is  appropriate  at  this  point 
to  discuss  why  we  have  chosen  to  investigate  relational  programming2. 

As  we  have  noted,  relational  programming  subsumes  functional  programming; 
hence,  anything  that  can  be  done  with  functional  programming  can  be  done  with  rela¬ 
tional  programming.  Furthermore,  relational  programming  has  many  of  the  advan¬ 
tages  of  functional  programming:  for  instance,  the  ability  to  derive  and  manipulate 
programs  by  algebraic  manipulation.  A  well  developed  algebra  of  relations  dates  back 
to  Boole's  original  work  and  has  been  extensively  studied  since  then.  Although  rela¬ 
tions  are  more  general  than  functions,  their  laws  are  often  simpler.  For  instance, 
(fg)~l  -g~lf  ~l  is  true  for  all  relations,  but  true  only  for  functions  that  are  one-to- 
one.  Also,  relational  programming  more  directly  supports  non-linear  data  structures, 
such  as  trees  and  graphs,  than  does  functional  programming.  In  relational  program¬ 
ming  the  basic  data  values  are  themselves  relations,  whereas  in  functional  program¬ 
ming  there  is  a  separate  class  of  objects  (lists)  used  for  data  structures.  One  final  rea¬ 
son  for  investigating  relational  programming  is  that  it  provides  a  possible  paradigm  frr 
utilizing  associative  and  active  memories.  As  a  teaser  for  what  is  to  come,  we  prcscr.' 
the  following  example  of  a  relational  program.  We  will  take  a  text  T,  represented  as  an 
array  of  words  (i.e.,  T{i)  is  the  i-th  word),  and  generate  a  frequency  table  F  so  the.!. 
F{ w)  is  the  number  of  occurences  of  word  w  in  T.  Now  we  will  see  (§4)  that  all  T  (w)  is 

the  set  of  all  indices  of  the  word  w.  If  we  let  size(C)  be  the  cardinality  of  a  set  C,  then 

1.  The  work  reported  herein  was  supported  by  the  Office  of  Naval  Research  under  contract  number  NOOOM- 
82-WR-20162,  and  by  the  Foundation  Research  Program  of  the  Naval  Postgraduate  School  r/ith  funds 

provided  by  the  Chief  of  Naval  Research. 

2.  The  reader  can  find  a  shorter  introduction  to  relational  programming  in  [HacLennanBS].  That  report  Is  a 
revision  and  extension  of  [MacLennonBla]  and  [MacLennonBlb]. 
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the  number  of  Indices  (occurences)  of  w  is  just  size[all  T  (tu)].  Therefore  we  cam  write 
F  =  size. (all  T)  (§7). 


i  and  Relation* 


Our  relational  calculus  will  deal  with  three  sorts  of  things:  individuals,  classes  and 
relations.  These  cam  best  be  illustrated  by  example.  If  ‘z’  is  the  name  of  an  individual 
and  'C'  is  the  name  of  a  class  (set),  then  'xcC"  means  that  the  individual  denoted  by 
‘x’  is  a  member  of  the  class  denoted  by  'C  (i.e.,  that  x  has  property  C).  Thus 
‘Aristotle  Eman'  would  indicate  that  Aristotle  is  a  man,  and  ’2eeven'  would  mean  that  2 
is  an  even  number.  Some  authors  (e.g.,  Russell  and  Whitehead)  use  'xtP'  for 
The  symbol  *€’  and  its  alternate  ‘s’  are  abbreviations  for  ’tori’,  which  is  the  Greek  word 
for  'is'. 

If  ‘x’  and  'y'  are  names  of  individuals  and  '/?'  is  the  name  of  a  relation,  then  x  Ry' 
means  that  x  bears  the  relation  R  to  y .  For  example, 

Aristotle  student  Plato 

means  that  Aristotle  is  a  student  of  Plato.  Also,  '2  <  3'  means  that  2  bears  the  less- 
than  relation  to  3.  A  relation  is  just  a  set  of  pairs.  Therefore,  if  we  use  x  \y  to  denote 
the  basic  pair-making  operation,  then  xRy  if  and  only  if  x  :y  e  R.  The  notation  that  we 
have  introduced  above  will  be  extended  to  classes  of  classes,  classes  of  relations,  rela¬ 
tions  among  classes,  relations  among  relations,  etc. 


There  are  several  ways  to  describe  classes  and  relations.  One  of  the  easiest  is  to  list 
its  elements,  for  example: 

S  =  f  1,  3,  5,  7  J 
R  =  {  l:a,  2:b,  3:c,  4:d  J 
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This  is  called  an  extensional  description  of  the  class.  Obvir  >sly.  this  is  only  possible  if 
the  class  or  relation  is  finite  and  only  practical  if  it’s  small.  Therefore  we  also  have 
intensional  descriptions  of  classes  and  relations. 

If  5(x)  is  a  sentence  involving  'x',  then  a  class  description  is  an  expression  of  the 
form  '{x  lS(x)l'.  This  denotes  the  class  of  all  individuals,  a,  for  which  5(a)  is  true,  i.e., 

ae{x|5(x)J  <=>  5(a) 

Similarly,  if  S(x,y)  is  a  sentence  involving  'x'  and  'y\  then  '\x.y  |5(x.i/)J'  is  &  relation 
description  which  describes  the  relation  that  holds  between  a  and  b  whenever  S(a,b) 
is  true,  i.e., 

njx:y  |5(x,y){b  S(a,b) 

To  illustrate  this  notation  we  will  define  the  converse  of  a  relation. 

2.3  cawaie 

The  relation  R ~1  is  called  the  converse  of  R,  i.e.  xR~xy  »  yRx.  Using  our  notation 
for  descriptions  we  can  define  R~x  -  \x:y  \  yRx\.  As  an  example  of  a  relation  among 
relations,  we  define  'inv'  as  the  relation  that  holds  between  converses: 
s  invr  o  r=s~l.  Hence,  inv  =  |s:r  |  r=s-1}.  Some  examples  of  converses  are 
parent1  =  child  and  <~l  =  >. 

EXERCISES:  Prove  the  following  properties  of  the  converse: 

=  r 

r  inv  s  o  s  inv  r 
inv-1  =  inv 

2.4  arrow  dlacnuns 

Relations  can  be  portrayed  by  arrow  diagrams  (Haase  diagrams).  In  such  a 
diagram  there  is  a  node  for  each  individual  related  by  the  relation  and  an  arrow  from  x 
to  y  whenever  xRy .  For  instance, 
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C 


represents  the  relation  R  such  that  bRa,  cRb,  dRb ,  eRd,  eRe,  bRe  and  -xRy  for  all 
other  cases: 

R  =  $  b:a,  c:b,  d:b,  e:d,  e:e,  b:e  J 

The  effect  of  the  converse  operator  is  to  reverse  all  of  the  arrows.  Hence,  R~l  is 
diagrammed: 


2.5  tables 

Relations  can  often  be  viewed  as  tables.  For  instance,  the  relation  R  of  the  previous 
section  can  be  shown  as  the  table  in  Figure  1. 


/ 

? 

b 

a 

c 

b 

d 

b 

e 

d 

e 

e 

b 

e 

Figure  1.  Relation  Viewed  as  a  Table 

Of  course,  it  makes  no  difference  in  what  order  we  write  the  rows  of  the  table. 

The  converse  of  a  relation  is  obtained  by  simply  exchanging  the  columns  of  the  table 
(see  Figure  2).  Of  course,  classes  are  represented  by  one  column  tables.  For  instance 
the  class  C  of  primes  less  than  ten  is  shown  in  Figure  3. 

3.  Domnina 

We  often  need  to  talk  of  the  individuals  that  can  occur  on  the  right  or  left  of  a  rela- 
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R~l 


a 

b 

b 

c 

b 

d 

d 

e 

e 

e 

e 

b 

F^ure  2.  Converse  of  a  Relation 

tion.  We  say  that  x  is  a  left-member  of  R  whenever  there  is  a  y  such  that  xRy . 

iLmif  «  3y(xRy) 

For  instance,  if  'x  parent  y '  means  that  x  is  a  parent  of  y,  then  ‘Socrates  Lm  parent’ 
means  that  Socrates  is  a  parent.  Right-member  and  member  are  defined  analogously: 

y  Rm  R  Bx(xRy) 
z  Mm  R  z  Lm  R  V  z  Rm  R 

EXERCISES:  Prove  that  these  satisfy  the  identities: 

xLmi?  o  xRm/T1 
yRmR  o  i/Lm/?-1 

4.  Functions 
4.1  basic  concepts 

Functions  and  relations  are  closely  related.  Consider  the  successor  relation,  'succ‘: 
x  succ  y  x  +  1  =  y.  Thus,  x  succ  y  says  that  x’s  successor  is  y .  The  corresponding 

arrow  diagram  is: 

1  2  3  4  5  ... 


and  the  corresponding  table  is  shown  in  Figure  4.  since  1  succ  2,  2  succ  3,  etc.  Notice 
that,  in  this  case,  for  each  left  member  x  there  is  a  unique  right  member  y  such  that 
x  succ  y.  This  y  can  be  written  using  Whitehead  and  Russell’s  [Whitehead7Q]  definite 
description: 
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A 


Figure  3.  Set  Viewed  as  a  Table 
ty(x  succ  y) 

This  can  be  read:  the  y  such  that  x's  successor  is  y.  A  more  convenient  way  to  write 
this  is  succ(x).  In  general,  R(x)  means  ‘the  unique  y  such  that  x  R  y\  i.e. 
R(x)  =  iy{xRy).  When  no  confusion  will  result  we  write  Rx  instead  of  R{x).  This  nota¬ 
tion  is  left-associative,  that  is,  Fxy  =  (Fx)y.  When  we  need  to  make  the  application 
operation  explicit  we  write  R@x  (R  at  x  or  R  applied  to  x)  for  Rx . 

The  functional  notation  is  meaningful  only  if  there  is  a  unique  y  such  that  xRy,  i.e. 
xRy  A  xRz  Oy=z.  That  is.  there  is  only  one  arrow  leading  from  x.  When  this  condi¬ 
tion  is  satisfied  for  all  x  we  call  R  right  univalent,  symbolized  by  ‘run’: 

.Rerun  o  Vjcj /*[  xRy  A  xRz  d  y-z  ] 

The  right  univalent  relations  are  more  commonly  called  functions.  In  a  left  univalent 
relation  there  is  exactly  one  arrow  leading  to  each  node.  Consider  the  ’absolute 
reciprocal'  relation:  xRy  o  y  =  |l/x|.  This  is  diagrammed  in  Figure  5.  Since 
Rerun  it  is  meaningful  to  write  R(x),  so  we  observe  R(-3)  =  1/3.  We  can  find  Rx  by 
following  the  arrow  pointing  from  x  or  by  looking  down  the  left  column  for  x  and  taking 
the  corresponding  element  from  the  right  column. 

The  concepts  of  left  univalence  and  bi-univalence  are  defined  analogously: 

Relun  o  Varyz  [  yRx  A  zRx  Dy=z  ] 

Rebun  «  Relun  A  Rerun 

Bi-univalent  relations  are  also  called  bijections  and  one-one  mappings. 
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Figure  4.  Function  Viewed  as  a  Table 


4.2  higher  level  functions 


Of  course,  the  converse  of  a  function  is  not  necessarily  a  function.  The  'sin'  relation, 
defined  so  that  x  sin  y  means  that  y  is  the  sine  of  x ,  is  right  univalent  but  not  left 
univalent-.  Hence,  we  can  write  either  y =sinz  or  x  sin  y ,  but  can  express  the  arcsine 
only  by  y  sin-1  x.  The  notation  sin-1  y  is  meaningless.  Since  /  (x)  is  meaningful  only 
when  /  erun  we  will  be  careful  to  write  /  (x)  only  when  we  have  previously  shown  (or  it 
is  obvious)  that  /  erun  and  x  Lm  / . 

The  fact  that  F(x)  may  be  meaningless  makes  it  convenient  to  use  several  other 
relations  derived  from  F.  One  of  these  is  the  image.  If  F  is  any  relation  and  C  is  a 
class  then  img  F  C  is  the  set  of  all  y  such  that  xFy  for  some  x  in  C,  i.e., 

img  F  -  \C:z  |  z  =  \y  |  3 x(xFy  AxeC)JJ 

Hie  tabular  interpretation  of  imgFC  is  shown  in  Figure  8.  We  see  that,  if  F  is  any  func¬ 
tion.  then  imgFS  is  the  image  of  the  class  S  under  that  function.  Notice  that  the 
operation  imgFS  is  defined  for  all  relations  F  and  classes  5,  regardless  of  whether 
Ferun  or  the  members  of  S  are  left  members  of  F .  For  these  reasons,  it  is  generally 
safer  to  write  imgFC  than  Fx . 

The  image  operation  is  also  useful  for  working  with  relations.  For  example, 
img.lnv(<)5  is  the  set  of  all  numbers  that  are  less  than  some  element  of  S.  The  rever¬ 
sal  of  the  sense  of  the  ordering  occurs  because  img(>)5  is  the  set  of  all  y  such  that  for 
some  xeS,  x>y .  Thus  img.inv(<)S  is  the  set  of  all  x  such  that  for  some  ycS ,  x<y. 


Related  ideas  are  the  image  and  converse  image  of  an  individual.  If  R  is  a  relation, 
then  c  =  unimgRx  means  that  c  is  the  class  of  individuals  related  to  x.  This  class  is 
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1 

1 

-1 

1 

? 

\/2 

-2 

1/2 

3 

1/3 

-3 

1/3 

• 

• 

Figure  5.  Right-Univalent  Relation  Viewed  as  Table 
called  the  unit  image  of  z,  and  is  defined  uni  mg  R  x  =  \y  \  xRy  J.  Alternately  we  can 

define  unimg/?x  =  img/?|zj. 

The  converse  idea  is  that  of  the  inverse  unit  image  of  y : 

unimg.inv  R  y  -  [x  \  xRy\ 

like  the  image,  unimg/?  and  unimg.inv/?  are  defined  for  all  R  and  all  arguments. 

We  can  also  apply  the  unit  image  operations  to  general  relations.  Therefore 
unimg.  inv(<)z  is  the  set  of  all  numbers  less  than  z.  This  is  sufficiently  common  that 
we  define  all = unimg.inv.  Then  all<x  is  the  set  of  all  numbers  less  than  x. 

Next  consider  the  function  all(=): 

all(=)z  =  \y  \y=x\ 

Hence,  all=x  is  just  the  unit  class  containing  x,  which  we  will  abbreviate  this  unz. 
Conversely,  if  C  is  a  single  element  class,  then  un-1C  selects  the  unique  member  of 
that  class:  un-1C  =  ix(zeC).  It  is  thus  a  uniqueness  filter.  We  will  write  this  as  tfC 
where  =  un-1.  The  expression  HC  can  be  read  'the  C.' 

EXERCISES:  Show  the  following: 

unimg  R~x  -  unimg.inv  R 
unimg.inv/?-1  =  unimg/? 
unimg  R  y  =  tmg  /?(un  y) 

It  is  often  convenient  to  have  names  for  domain  extracting  functions,  e  g.,  dom  R  is 
the  class  of  left  members  of  /?.  These  are  simply  defined  using  images: 
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*1 

y.i 

*1* 

Vn 

Figure  6.  Image  Operation  Applied  to  Tables 
dom  =  all  Lm 

dom.inv  =  all  Rm 

mem  =  all  Mm 

Of  course  the  left  members  (domain)  and  right  members  (domain-inverse)  of  a  relation 
can  be  obtained  by  taking  its  left  and  right  columns,  respectively,  and  deleting  dupli¬ 
cates  (Figure  7). 

R 


/  \ 

□  n 


dom  R 


dom.inv  R 


Figure  7.  Domain  Extracting  Operators 

&  Boolean  Operations 
Bil  logical  connectives 

We  will  next  investigate  ways  of  combining  relations  and  classes.  The  simplest 
methods  are  just  abstractions  of  the  logical  connectives  used  between  propositions. 
Therefore,  we  define  the  intersection,  union,  negation  and  difference  of  classes  and 

relations: 

xe(S  n  T)  e*  xeS  A  xeT 
xe(S  u  T)  xeS  v  xeT 
xe(~S)  <♦  -(xeS) 


W  -  *  «  *.  .V  *«  *,  •«  .  %  *  *.• 
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xe(S\T)  o  xeS  A  -(xe7) 
xe(SoT)  ic5Daer 

As  an  example  of  the  use  of  these  operations,  consider  our  previous  definition  of  Mm: 

z  Mm  R  z  Lm  R  V  z  Rm  R 

Using  the  union  operation  this  can  be  written  Mm  =  Lm  u  Rm.  Similarly,  bun  =  lun  n 
run  The  logical  connectives  satisfy  the  usual  properties  of  a  Boolean  algebra  (e  g.. 
DeMorgan's  theorem). 

As  an  example  of  the  use  of  these  operations,  we  will  define  the  closed  interval  func¬ 
tion.  [m..n],  which  is  the  set  of  integers  m,  m  +  1 . n.  It  is  just: 

[m.,n]  =  all&m  n  all^n 

where  <  and  >  are  the  relations  on  integers.  In  general  we  will  allow  [m.  n]  for  any 
types  on  which  a  strict  order  is  defined. 

EXERCISES:  Define  the  analogous  notations  ( m..n ),  [m...n),  and  ( m..n ]. 

5.2  empty  dm 

It  is  useful  to  have  a  name  for  the  empty  class:  0  =  S\S.  for  any  set  S.  Hence, 
xe0  is  always  false.  This  is  most  often  used  for  stating  properties  of  relations  and 
classes.  For  instance.  S  n  71  =  0  means  that  classes  5  and  T  have  no  members  in 
common. 

Hie  universal  class  is  also  useful:  O  =  ~0.  For  instance,  S  u  T  =  O  means  that 
every  individual  is  either  a  member  of  5  or  of  T.  Notice  that  the  class  of  the  right 
members  of  a  relation  is  just  the  image  of  the  universe  under  that  relation,  i.e., 

dom.inv  R  =  img/?0 
dom  R  =  imgR-10 
mem  R  =  img(/?  <J  R~l)0 

EXERCISES:  Prove  these  properties  of  the  domain  functions. 
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5l3  Carteun  product 

It  is  often  useful  to  have  the  maximum  relation  that  cam  hold  between  two  classes, 
i.e.,  the  Cartesian  product  of  those  classes.  This  is  defined: 

SxT  =  \x:y  |  ieS  Aj/erj 

EXERCISES:  Show  the  Cartesian  product  satisfies  the  following  properties: 

(sxf)-1  =  fxs 
dom(sxf)  =  s 
dom.inv(sxf)  =  t 
mem(sxf)  =  s  u  f 

sx(f  n  u)  =  (sxf)n(sxu) 
sx(fuu)  =  (sxt)  u  (sxu) 
sx(f\u)  =  (sxf)\(sx~u) 
sx(f  dii)  =  (s  x  ~f)  u  (sxu) 

SX0  =  <f)XS  =  0X0  =  0 
sxf  =  (sxO)n(Oxf) 

5.4  subset  relation 

Finally,  we  define  the  subclass  operation: 

SqT  Vz(xe5  3xe7’) 

EXERCISES:  Show  the  following  are  true: 

scf  3  (sx-u)c(fxu) 

scf  3  (rxs)c(rxf) 

scl  Aucu  3  (sxu)c(fxv) 

ft.  limiting  and  Restriction 

It  is  often  useful  to  limit  the  left  or  right  domain  of  a  relation.  Consider  the  relation 
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y  sin-1  x,  which  means  that  x  is  an  arcsine  of  y .  We  cannot  write  x  —  sin-1y  because 
sin-1  is  not  right  univalent  (i.e.  it  is  not  a  function).  If  we  restrict  y,  the  argument  of 
win,  to  the  range  -rr/4  to  rr/4,  then  there  is  a  unique  x  such  that  y  sin-1  x.  Let  5  be 
the  class  of  reeds  in  the  range  -n/  4  to  n/  4: 

S  =  (-w/ 4.  .rr/4]  =  all>(-rr/4)  n  alte(7r/4) 

then  we  will  write  S-»sin  for  the  sine  function  with  its  arguments  restricted  to  S.  This 
function  is  bi-univalent,  so  it  is  invertible.  If  we  call  the  inverse  of  this  restricted  sine 
Arcsin: 

Arcsin  =  (5  -»sin)-1 

then  it  is  perfectly  meaningful  to  write  Arcsin  x  (if  x  Rm  sin).  The  left-restriction 
operation  is  defined: 

x(S-»i?)y  «  x eS  A  xRy 


In  other  words, 


y  -  (S-»/?)x  <=>  y  =  Rx  /\  xeS 
The  right-restriction  is  defined  analogously: 

x(R *-S)y  xRy  AyeS 

These  notations  can  be  combined  to  restrict  both  domains: 


x  {S-*R*-T)y  <=>  xe5  Ax/fy  AyeT 

The  combination  s-*B*-s  is  so  common  that  a  special  notation  is  provided  for  it: 
Rts  =  s-*R*-s.  For  instance,  <t P,  where  xeP  x>0,  is  the  less-than  relation  res¬ 
tricted  to  positive  numbers.  Notice  that  x  succ  y  if  and  only  if  y  is  the  successor  of  x. 
Therefore  we  can  define  the  sequence  of  integers  (m.,m.  +  l,  .  .  .  ,n)  by  restricting  the 
succ  relation: 


[m.  .n]  =  all>m  -»  succ  «-  all^n 


See  Figure  8  for  a  tabular  representation  of  the  domain  restricting  operations. 
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Figure  B.  Domain  Restricting  Operations 

EXERCISES:  Show  that  the  restriction  operations  can  be  defined  in  terms  of  inter¬ 
section  and  Cartesian  product: 

s-*r*-t  =  r  n  (sxt ) 
rts  =  r  n  (sxs) 
s-»r  =  r  n  (sxO) 
r*-s  =  r  n  (Os) 

EXERCISES:  Show  that  other  properties  satisfied  by  these  operations  are: 

sxt  =  s-»OxO«-t 
dom(s-*r)  =  s  n  dom(r) 
dom.inv(r*-s)  =  s  ndom.inv(r) 
dom(r«-s)  =  img  (r-I)s 
dom.inv(s-»r)  =  img  r  s 

(s-*r)-1  =  (r_1)«-s 

=  f-*(r-1)*-s 
(rts)-1  =  (r_,)Ts 

r«-s  n  r*-t  =  r*-(s  n  t) 
t *~s  ur«-f  =  r«-(s  u  t) 

(rxO)«-s  =  rxs 

7.  Relative  Product  and  Ccxnpantion 

If  xsony  is  the  relation  'x  is  a  son  of  y'  and  zbrothery  is  the  relation  ‘z  is  a  brother 
of  y\  then  the  relative  product,  ‘son  I  brother',  is  the  relation  ‘a  son  of  a  brother  of’. 
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More  formally, 

R\S  =  \x:z  |  By{xRy  S\ySz)\ 

We  will  also  write  S.R  and  S°R  for  R  |S.  The  reason  for  this  is  that  if  F  and  G  are  func¬ 
tions  it  is  easy  to  see  that  F.  G  is  the  composition  of  these  functions: 

z  =  F.Gx  o  x  F.G  z 
o  xG\Fz 
«  3y(xGy  A  yFz) 
o  By[z=Fy  S\y  =  Qc] 
o  z  =F(Qc) 

Hence,  F.Gx  =  F(Qc). 

It  is  convenient  to  have  a  notation  for  relative  products  of  a  relation  with  itself.  For 
instance,  the  'grandparent'  relation  can  be  written  'parent | parent',  which  we  abbrevi¬ 
ate  parent2.  In  general, 

R°  =  (=)r(mem  R) 

R1  =  R 

Rn*1  =  (/?n)|ff  =  R\(Rn) 

R^  =  (Rnrl 

EXERCISES:  Show  these  obvious  properties  of  the  relative  product: 

(r.s).f  =  r.  {s.t) 
r.  (s  u  t )  =  r.s  u  r.t 
(r  u  s).t  =  r.t  u  s.t 
r.  (s  n  t)  c  r.s  n  r.t 
(r  n  s).t  Q  r.t  n  s.t 
3 (r.s)  3(dom.inv  r  n  dom  s) 

where  3  r  means  Be  [x  er  ] 
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(r-‘)“ 

=  r 

(r.s)"1 

=  (s'1) 

L(r-») 

rm.rn 

—  r»n+n 

(m,n>0) 

( rm)n 

_  rmn 

(m.,n&0,  or  rebun) 

rm.rn 

q  rm+n 

(r  ebun) 

r.r~l  = 

:  r~l.r 

=  r°  (rebun) 

dom(r.s)  c  domr 
dom.inv(r.s)  c  dom.invs 
Lm  =  Rm  |  inv 
Rm  =  Lm  |  inv 

r.  (0x0)  =  (0x0).r  =  0x0 

r.  Id  =  Id.r  =  r  where  Id  =  (=)  (the  identity  function) 

BL  Structures 

We  have  previously  seen  the  use  of  arrow  diagrams  to  represent  a  relation.  For 
instance,  the  diagram  in  Figure  9  represents  the  relation  R  shown  in  Figure  10. 


8.1  initial  and  twTninal  members 

Now,  notice  that  the  domain  (left)  and  codomain  (right)  members  of  R  are: 

dom  R  =  $  a,  b.  c,  d,  e,  f,  g  } 
dom.inv  R  =  {  g,  f,  e.  d,  i,  h  j 

We  define  the  initial  members  of  R  to  be  those  members  which  are  not  pointed  at  by 
an  arrow.  Therefore,  the  initial  members  of  R  are  the  left  members  that  are  not  right 
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R 


a 

_JL 

b 

_ f_ 

c 

_ e 

_d_ 

_d 

d 

e 

e 

_ i_ 

f 

_f_ 

f 

i 

f 

_h 

Figure  10.  Tabular  Representation  of  a  Structure 
members,  that  is,  the  domain  members  that  are  not  codomain  members. 

init  R  =  dom(/?)  \  dom.inv(/?)  =  $a,  b,  cj 

The  terminal  members  of  a  relation  are  defined  analogously: 

term  R  =  dom.in v(R)  \  dom(R)  =  $h,  ij 

When  a  relation  is  used  to  represent  a  data  structure,  the  above  functions  become 
important. 

For  instance,  a  sequence  is  represented  by  a  relation -with  the  structure: 

S  -  °i  a2  °a  °»-l  “n 

•  »•  >« - -*• — 

In  this  case  init  S  is  the  unit  class  containing  the  head  (first  element)  of  the  relation 
(i.e.,  aj)  and  term  5  is  the  unit  class  containing  the  last  element  of  the  sequence  (i.e. , 
a*).  Similarly,  (~.init  S)-*S  is  the  sequence  with  its  first  element  deleted: 

a2  a3  °n-l  °n 

Hence,  the  following  common  sequence  manipulation  functions  can  be  defined: 


a  S  =  tf.init  S 

first 

u  S  =  tf.term  5 

last 

0  5  =  (~.init  S)->S 

final 
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A  5  =  S«-(~.term  S)  initial 

EXERCISES:  Prove  the  following  properties  of  these  relations: 

a  =  w.inv 
u  =  a.inv 
A.inv  =  inv.Q 
O.inv  =  inv.A 


More  operations  on  sequences  are  discussed  in  the  next  section. 


As  another  example  of  the  use  of  'init'  and  ’term',  consider  the  relation,  represent- 


Flgure  11.  Relation  Representing  a  Tree 

Then,  aT  is  'a',  the  root  of  the  tree,  and  term  T  is  fd.  h.  i.  f.  j.  k{,  the  leaves  of  the  tree. 


figure  12.  Relation  Representing  a  Forest 

Given  the  relation  in  Figure  12,  the  set  of  roots  is  init  F  and  the  set  of  leaves  is  term  F : 
init  F  =  fa.i.gj 

term  F  =  |c1e,f,g,h,j,k.l,m,n,t,u,v,wj 

8.2  higher  level  operations 

The  set  of  nodes  whose  parent  is  n  is  just  imgFVi.  For  instance,  the  set  of  nodes 
directly  descended  from  a  root  is 
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(img  /’J.init  F  =  {b.h.j.o.p.rj 
Hie  set  of  nodes  that  point  to  leaves  is 

(img  F-^.term  F  =  {b,d,a,i,o,p,s,r{ 

These  operations  can  be  used  for  obtaining  the  maximum  and  minimum  of  sets. 
Suppose  '<'  is  the  less-than  relation  on  integers  and  S  is  some  set  of  integers,  say 
{3.5.9J.  Then 

<T  S  = 

3  5  9 

Now  note  that  init(<tS)  =  $3j  and  term(<tS)  =  \9\.  Hence,  if  S  is  any  set  of 
numbers,  then  the  minimum  and  maximum  of  this  set  are: 

min  5  =  a(<tS) 
max  S  =  &>(<tS) 

Notice  that  we  can  select  the  maximim  and  minimum  based  on  any  relation  that  is  a 
series  (i.e.,  transitive,  irreflexive  and  connected).  If  R  is  any  series  then  a(RtS)  is  the 
minimum  (relative  to  R)  and  u(RtS)  is  the  maximum. 

EXERCISES:  Show  that  the  following  are  properties  of  these  operations: 

init  r  =  term(r_1) 
termr  =  init(r_l) 
init  c  dom 
term  C  dom.inv 
init(rts)  =  term(r_1ts) 

init(r  us)  c  init r  u  init  s 
init  r  rs  init  s  c  init(r  n  s) 
term(r  us)  c  term  r  u  term  s 
termr  n  terms  c  term(r  ns) 
init(sxf)  =  s\f 
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term(sxf)  =  init(sxf)  1  =  init(fxs)  =  f\s 

9.  Sequences 
9.1  ordinal  couples 

In  this  section  we  will  continue  the  discussion  of  sequences  begun  in  the  last  section. 
We  saw  that  it  was  easy  to  define  the  following  operations  on  sequences: 

o  5  =  tf.init  S 
a  S  =  iJ.term  S 
AS  =  S«-(~.termS) 

Q5  =  (~.init  S)-*S 

This  provides  us  with  functions  for  taking  sequences  apart.  We  will  define  the  ordinal 
couple  or  pair,  which  puts  them  together.  If  x  and  y  are  two  objects,  then  '( x,y )'  is 
the  relation  that  relates  x  and  y  but  no  other  objects. 

x  y 

That  is,  u{x,y)v  if  and  only  if  u=x  and  y=v.  This  is  formally  defined  by: 

x.y  =  \u:v  |  u-x  /\v=y\  =  un(x)  x  un(y)  =  un(x :y) 

Notice  that  x:y  =i}(x,y).  Observe  also  that  oc(x,y)  =  x  and  «(x ,y)  -  y.  Finally, 
xRy  <t*  (x ,y)z.R . 

Explicit  relations  can  be  described  by  a  combination  of  the  pair  and  union  opera¬ 
tions.  For  example,  we  have  the  identity: 

\  *iVi.  Xz  Vz . Xn  Vn  }  =  (*i.Vi)  u  {xz,yz)  u  •  •  •  u  (x„,y„) 

We  will  define  a  convenient  notation  for  sequences  of  two  or  more  elements: 

i  X|,  xz . xn)  =  \x\.xz,  xz:x3 . Xji^i'.XjiI 

Therefore  the  sequence  (a,b,c,d,e)  is  just 
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abode 


9.2  MUnitf  ion  and  canaing 


If  s  and  t  are  sequences  then  we  can  define  an  operation  'sH' ,  which  is  the  catena¬ 
tion  of  s  and  f .  To  form  this  catenation  we  must  hook  the  last  element  of  s  to  the  first 
element  of  t : 


1 1  am 


sm  ~  ^  1  ~  s  \  sm  t 1 


Therefore  x [s~t  \y  if  and  only  ifx  s  y,  or  x  t  y,  orx=os  and  y=a  t .  Hence. 

sH  =  s  v  {u  s,  at)  u  t 

The  catenation  operation  is  only  defined  for  sequences,  which  are  required  to  have  at 
least  two  elements  (since  an  irreflexive  relation  with  less  than  two  elements  is  the 
empty  relation).  This  issue  is  discussed  in  the  following  section. 

How  then  do  we  add  a  single  element  to  the  left  or  right  of  a  sequence?  The  ‘cons 
left'  and  'cons  right’  operations  are  easy  to  define: 


X  Cl  Si 


sn  =*  x  si 


x  cl  s  =  (x ,  a  s)  v  s 
s  cry  =  s  u  (us,  y) 

If  5  is  a  sequence  and  xMmS,  then  Sx  is  the  successor  of  x  in  5  and  5~'x  is  the 
predecessor  of  x  in  S  (if  these  exist). 

Sx  =  successor  of  x  in  S 
S~lx  =  predecessor  of  x  in  5 


These  are  convenient  ways  of  moving  around  within  a  sequence.  Also,  note  that  if  s  is  a 
subsequence  of  t  thensef .  Some  additional  identities  are: 
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(*.J/)l(V.z)  =  (*•*) 

img  a  ( SxT )  -  S 
img  u  (S*T)  -  T 

EXERCISES:  Show  that  if  s  is  a  sequence,  then; 

a(x  cl  s)  =  x 
fl(x  cl  s)  =  s 

w(s  cry)  =  y 
A(s  cr  y)  =  s 

(as)  cl  (Os)  =  s,  if  size  s  >2 
(As)cr(os)  =  s,  if  size  s  >2 

Also,  if  s  is  a  sequence,  show  that  su(us,as)isa  ring  formed  by  joining  the  last  ele¬ 
ment  of  s  to  the  first  element. 

If  s  is  a  sequence,  then  s-1  is  the  reverse  of  s.  Hence,  revs  =  s-1.  Show  the  follow¬ 
ing: 

as  =  os_I 
«s  =  as~* 

As  =  (Os'1)"1 
Os  =  (As-1)-1 

(s-i)"1  = 

(x  cl  s)~‘  =  s_I  cr  x 
(s  cr  x)_1  =  x  cl  s~l 

(*.v)_1  =  (V-x) 

(  X|,  Xg . Xn)  1  =  (  Xj, . Xg,  Xj) 
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XSVZ . Xn  Vnl'1  =  \V\X\.  Vz*Z . 

8.3  alternative  definitions  of  sequences 

We  will  state  the  formal  definition  of  a  sequence:  a  relation  is  a  sequence  if  it  is  a 
connected  irreflexive  bijection.  That  is, 

sequence  =  connex  n  irrefl  n  bun 
seirrefl  s°cs_1 

seconnex  «  doms  =  init  s  udoms'1  A  doms_1  =  terms  udoms 

Although  the  preceding  definition  of  sequences  is  very  convenient,  it  has  a  number  of 
limitations.  For  example,  the  operations  discussed  above  are  only  defined  for 
sequences  with  two  or  more  elements,  since  an  irreflexive  relation  cannot  relate  less 
than  two  elements.  In  particular,  (2)  =  0.  One  solution  to  this  problem  is  to  use  a  stan¬ 
dard  "end  marker"  for  all  sequences,  say  ‘EOF’.  For  example,  the  sequence  1,  3,  5 
would  be  represented  by  the  relation  (1.3.5.E0F).  A  one  element  sequence  containing  3 
would  be  represented  by  (3.EOF)  and  an  empty  sequence  by  (EOF)  =  ()  =  0.  This 
definition  has  some  curious  properties  of  its  own.  For  example,  the  relation 
(3.3.EOF)  =  (3:3,  3:E0FJ  has  no  initial  members  and  in  fact  is  not  a  sequence  (since  it's 
not  irreflexive).  Of  course  this  objection  also  applies  to  our  original  definition  of 
sequences. 

A  different  solution  is  to  extend  the  definition  of  sequences  so  as  to  allow  length  one 
sequences  by  making  the  relation  reflexive. 

s  u  (=  T  mem  s) 

-J) 

Sl  Sg  Sg  Sn 

The  one  element  sequence  is  then: 

0 

So  -  (so.  So) 
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This  still  does  not  solve  the  problem  with  repeating  elements  in  sequences,  however. 

An  alternative  definition  of  sequences  is  based  directly  on  the  pair-making  opera¬ 
tion.  Define  <>  to  be  some  distinguished  value  'nil'.  Then  define 

<Xi,X2 . *n>  =  xi:<x2 . Xn> 

We  can  see  that 


<xi,z2 . Xn>  =  x1:z8:...:xn:nil 

(We  have  assumed  *:'  is  right-associative  in  the  above  equation.)  This  is  essentially  the 
way  lists  are  represented  in  LISP.  A  more  comprehensive  solution  to  these  problems  is 
discussed  in  Chapter  16,  Data  Structures. 


10.  Gbury  Operations 
10.1  bmic  concepts 

In  this  section  we  will  discuss  our  approach  to  binary  operations  —  that  is,  to  func¬ 
tions  with  two  arguments  and  one  result.  We  have  already  seen  how  unary  functions 
are  connected  to  relations.  For  instance,  we  can  write  the  fact  that  y  is  the  sine  of  x 
by  either  xsiny  or  y  =  sinx.  Since  we  only  deal  with  binary  relations,  we  will  have  to 
have  a  new  convention  for  handling  binary  functions.  This  convention  is.  we  will  com¬ 
bine  the  two  arguments  of  an  operation  into  a  pair.  For  instance,  we  can  define  a  rela¬ 
tion  ‘sum1  such  that  (x,y)  sum  z  if  and  only  if  z  is  the  sum  of  x  and  y.  More  formally: 

sum  =  [a:z  |  3x,y[a  =  (x,y)  A  z  =x+y]{ 

We  can  use  our  function  application  convention  as  usual,  e.g., 

z  =  sum(z.y)  <=>  (x,y)  sum  z 

Now,  it  would  be  inconvenient  to  have  to  invent  names,  such  as  'sum',  for  each  opera¬ 
tion,  such  as  '+'.  Hence,  we  will  adopt  a  systematic  convention  for  making  such  names: 
placing  the  conventional  infix  symbol  for  the  operation  in  parentheses  or  other  brack¬ 
ets.  For  instance, 


-23- 


RELATIONAL  PROGRAMMING 


(x,y)[+]z  o  z  =  [+](*.!/)  °  z  -  X+V 
In  fact,  if  n  is  any  infix  operation  symbol,  we  will  explicitly  define  its  meaning  by 

xrry  =  [n](x,y) 

This  notation  will  permit  us  to  manipulate  in  a  more  regular  fashion  the  usual  arith¬ 
metic  operations  (+,  -,  x,  /)  as  well  as  the  relational  operations  (e.g.  n,  u,  -»,  f,  x). 
We  omit  the  brackets  when  the  meaning  is  clear  without  them.  For  instance,  if  S  is  a 
class  of  classes,  then 

img  n  (5xS) 

is  the  class  of  all  pairwise  intersections  of  members  of  S. 

10.2  operation  an  binary  operation* 

It  is  often  convenient  to  be  able  to  generate  simple  relations  from  a  binary  opera¬ 
tion.  Following  Russell  and  Whitehead  [Whitehead70],  let  n  represent  any  binary  opera¬ 
tion.  We  define: 

(Try)  =  \x:z  j  xrry  =  z  j 
(xtt)  =  \y.z  |  xrry  =  z{ 

Hence,  x(-l)y  y  =x-l,  therefore  (-1)  is  the  predecessor  function.  Similarly, 
x(l+)y  <=>  y  -  1+x,  therefore  (1+)  and  (  +  1)  are  both  the  successor  function.  These 
can  be  used  as  functions:  (-l)x  =  x-land(+l)x  =  x  +  1. 

This  convention  makes  it  very  easy  to  form  more  complex  functions.  For  instance,  if 
we  want /(x)  =  sin(l/x)  then  we  can  define  /  =  sin.(l/).  To  see  that  this  works: 

/(x)  =  [sin.(l/)]x 
=  sin[(l/)x] 

=  sin[l/xj 

Again,  we  omit  the  brackets  when  the  meaning  is  clear  from  context  or  can  be  made 
clear  by  spacing.  Furthermore,  we  adopt  the  convention  that  if  two  binary  operators 
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occur  together,  then  the  first  is  taken  in  its  unary  sense  and  the  second  in  its  binary 
sense.  For  example,  sxut  means  [sx]uf ,  not  sx[uf  ].  When  a  binary  operator  is  used 
in  its  unary  sense,  it  will  be  taken  to  be  very  binding;  that  is,  f.x u  means  /.[xu],  not 
(/.x)u. 

Now  observe  the  action  of  the  (x ,)  and  (,y)  functions: 

{x,)y  =  ( x.y ) 

(. v)z  =  (x.y) 

Therefore,  for  any  binary  operation  n  (except  ’,')  we  can  define 

*y  =  [tt]  (.v) 

xi t  =  [n].(x.) 

Let’s  see  why  this  works: 

(xn)y  =  [(fr).(x,)]y 

=  {*)[(* -)v] 

-  (tt)[x.1/] 

=  xiry 

TTie  form  (rry)z  is  analogous.  In  general,  if  /  is  a  binary  function,  then  /.  (x,)  and 
/.  (,y)  are  the  "partially  instantiated"  unary  functions.  This  is  the  effect  of  Curry  and 
Feys  'B'  combinator  [Curry58]. 

Since  S~l  is  the  reverse  of  a  sequence,  n.inv  is  the  reverse  form  of  ar,  operation. 
For  instance,  -.inv  is  the  reverse  subtract  operation: 

-.inv(x  ,y)  =  -(inv(x,y)) 

=  -iv~x) 

-  y-x 

Thus  -  inv  can  be  read  'subtract  from'  and  /  .inv  can  be  read  'divide  into'.  This  is 
Curry  and  Feys  'C'  combinator  (see  the  next  section). 


-25- 


RELATIONAL  PROGRAMMING 


11.  Com  bins  tors 

11.1  fwltellwg  «l  rwlntinrw 

In  this  section  we  will  discuss  several  powerful  operations  for  manipulating  relations. 
These  are  called  comb-motors  because  of  their  similarity  to  the  combinators  of  Curry 
and  Feys  [Curry58]. 

The  first  combinator  we  will  discuss  is  the  paralleling  of  relations,  R\\S ,  which  is 
defined: 

(■u.i/)Rjj5(*,i/)  uRx  /\vSy 

So,  if  /  and  g  are  functions,  [f\\g](x,y)  =  [/(x),  </(]/)].  Hence.  f\\g  is  the  element¬ 
wise  combination  of  /  and  g .  For  example,  if  we  want  /  (x  ,y)  =  sin  x  +  cos  y ,  we  can 
write  /  =  +.(sin||cos)  since 

/(*.!/)  =  [+(sin||cos)](x  ,y) 

=  +[(sin||cos)(x ,!/)] 

=  +[sinx,  cos  y] 

=  sin  x  +  cos  y 

11.2  conditional  union 

The  restriction  operations  allow  us  to  define  the  very  useful  conditional  union  or 
overlay  operation  [MacLennan75],  R\S  =  R  u  ~.dom R  -»  S.  In  other  words,  the  value 
of  (R;S)x  is  Rx  if  zedom/?,  and  Sx  otherwise.  This  has  many  uses.  For  example,  if  / 
is  a  partial  function,  then  /  ;Id  is  the  extension  of  /  to  the  identity  function.  That  is, 
(/  ;Id)x  is  fx  if  that  is  defined  and  x  otherwise. 

The  conditional  union  is  useful  for  defining  conditional-like  structures.  For  example 
p-*/  \g  is  a  function  that  applies  /  if  p  of  its  argument  is  true,  and  applies  g  otherwise: 

r  ,  i  lfx  ifP* 

[p-/;y]*  =1^.  if  .px 

(This  assumes  p  cdom/  .  Why?)  Therefore  we  have  the  equivalent  of  Backus'  conditional 
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combining  form  p-*f\g- 

Hie  overlay  operation  is  also  useful  for  updating  functions  representing  tables.  For 
example  ( i,x)\T  is  a  table  just  like  T  except  that  Ti  is  now  a:,  regardless  of  whether  Ti 
was  defined  or  not.  Similarly,  S\T  is  a  table  in  which  all  the  entries  of  S  have  been 
added  to  T,  possibly  replacing  corresponding  elements  already  there. 

11.3  combinatory  logic 

One  of  the  simplest  combinators  described  by  Curry  and  Feys  is  the  elementary  can- 
cellator,  K,  defined  so  that  Ke  is  a  function  such  that  (K x)y=x  for  all  y .  That  is,  K gen¬ 
erates  constant  functions.  Since  Kz  is  a  relation  that  relates  x  to  everything,  we  can 
define  it:  K  =  (Ox).un,  where  un  =  d-1  is  the  unit  class  generator.  To  see  that  this 
works,  note  that 

Kx  =  Ox.unz  =  Ox(unx) 

and  therefore  that 

■u(Kz)u  o  u[Ox(unx)}i» 

«  ueOAveun(x)  <=>  v=x 

Therefore,  for  arbitrary  u,  (Kx)u  =  x. 

Another  combinator  is  the  elementary  duplicator,  W.  defined  so  that 
(W/)x  =  /  (x,x).  If  we  define  A  x  =  {x.x)  then  it  is  easy  to  see  that  W/  is  just  /.  A.  For 
instance.  x.A  is  the  squaring  function: 

x.An  =  x(A n)  =  x(n,n)  =  nxn  =  nz 

It  should  be  clear  that  Backus'  [/  ,5]  combining  form  is  just  our  (/  ||p).A,  since 

(/l!ff)  Az  =  f\]g  (x,x)  =  ( fx.gx ) 

Since  this  combination  is  so  common  we  will  adopt  a  special  notation  for  it. 
f~g  =  (/llp)-A.  Hence,  {f~g)  x  =  ( fx.gx ) 
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EXERCISES:  Show  that  some  of  the  properties  satisfied  by  these  combinators  are: 
(R\\S).(T\\U)  =  (R.T)\\(S.U) 

msr  =  (xn)\\(sn) 

( r;s).t  =  ( R.Tfts.T ) 

(i?||5).(77C/)  =  ( R.TftS.U ) 

LR  =  R7R 

(R||5).inv  =  (S\\R)  =  inv.(R||5) 

inv.(/?TS)  =  S7R 

a.(R7S)  =  (dom  S)-*R 

o.(RiS)  =  (dom  R)-*S 

i?||5  =  (R.ciftS.u) 

ci  =  (crt))-1 

cr  =  (ATcj)~1 

EXERCISES:  Show  that  /  =  +.(x.A7  2x)  is  the  function  /  (f  )  =  f2+2f . 

The  formalizing  comJbirtator,  $,  is  defined  so  that  [$/(a,b)]x  =  /[a(x),6(x)].  It  is 
easy  to  see  that  $/ (a, 6)  =  f.{a~b).  For  instance, 

/  =  $+[x.A,  2x] 

is  just  the  function  f{t)  =  tz+2t .  This  can  be  written  directly  using  the  notation  of  our 
relational  calculus: 

/  =  +.(x.A72x) 

Hie  combination  $rr[/  ,g]  occurs  very  frequently.  Therefore,  we  define  rf  =  $tt  to  be  the 
formalization  of  the  operator  rr.  Notice  that  [fng]x  =  ( fx)n{gx ).  In  particular,  the 
function  ft  =  tz+2t  can  be  written 

/  =  x.AT  2x 

In  general,  n.{f~g)  -Jl^g 
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Another  combinator  is  the  meta-application  operator,  ®,  which  corresponds  to  Curry 
and  Feys'  S  combinator:  (f9g)x  =  (fx)@  ( gx ).  For  instance,  imgoinit  is  the  operation 
that  gives  the  set  of  descendents  of  roots  of  a  forest  F,  since 

(img©init)F  =  (img  F)@  (init  F)  -  (img  Fj.init  F. 

Another  combinator  defined  by  Curry  and  Feys  is  the  ^  combinator: 

[*(/.?)  =  /te(*).s(y)] 

This  is  simply  defined  by  *(/  ,g)  =  f.(g\\g).  Therefore,  if  /  =  *[  +  ,  x.A]  then 

/  (x,y)  =  xz+yz.  This  can  also  be  written  /  =  x,4,a  ? 

11.4  Carried  functions 

A  function  /  is  called  a  Curried  derivative  of  g  if  fxy  =  g(x,y).  We  define  operators 
'curry*  and  'uncurry'  such  that  /  =  curry  g  and  g  =  uncurry  / .  First  consider 
uncurry: 

(uncurry/  ){x,y)  =  g(x,y) 

=  fxy 
=  (/a r)@y 
=  ®[(/x).y] 

=  @[/llid](*.y) 

By  canceling  ( x,y )  from  both  sides  we  see  that  uncurry/  =  @.[/||Id].  If  we  wish,  we 
can  factor  /  out  of  this  expression  in  this  manner: 

uncurry/  =  @.[/||ld] 

=  [•.][/ Hid] 

=  [@-].[l|Id]/ 

Hence,  uncurry  =  [@.].[||Jd]. 

Next  consider  Currying.  One  solution  is  to  simply  define  curry  =  uncurry-1;  we  can 
learn  more  however  by  defining  curry  directly.  Suppose  we  are  given  a  Curried  pair- 
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making  function  ‘n’:  nxy  =  (x,y).  Then, 

fxy  =  (curry  g)xy  =  g(x,y)  =  g  {nxy)  =  g{[nx]y)  =  g.[% rx]y 
Therefore,  canceling  y  from  each  side  we  get: 

curry  gx  =  g.  (nx)  =  [g.  ](rrx)  =  [g.  ].rrx 
Hence,  curry  g  =  [y.  ].n. 

As  a  final  example  we  derive  Curry  and  Feys‘  C  combinator:  C fxy  =  fyx .  Observe: 
Cfry  =  fyx  -  ( fy)@x  =  [@x](/y)  =  [@x]./y 
Therefore,  by  canceling  y  we  get: 

C/x  =  [«*]./  =  [•/][©*]  =  [-/]-[®]* 

Hence,  Cf  =  [./].© . 

EXERCISES:  Show  the  following  properties  satisfied  by  these  combinators: 

(Kx)./  =  dom /  -»Kx 
/.(Kx)  =  K (/x) 

C  =  curry,  [.inv], uncurry 

12.  Records 

12.1  basic  operations 

By  a  record  we  mean  a  finite  function  whose  domain  is  other  than  a  contiguous  sub¬ 
set  of  the  integers.  For  example,  the  following  relation  might  represent  a  personnel 
record: 

R  =  $  name  :  "Don  Smith",  age:  40, 

hire-date:  {mo:"Aug",  dy:31,  yr:19B0|,  salary:  40000  j 

The  selectors 

name,  age,  hire-date,  mo,  dy,  yr,  salary 
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might  be  the  strings  "name",  "age",  etc.  or  the  integers  1,  2,  etc..  We  are  not  con¬ 
cerned  with  their  exact  nature  so  long  as  they  are  distinct.  A  field  is  selected  by  apply¬ 
ing  the  record  to  the  field's  selector:  /?(age)  =  R@age  =  40.  Thus  'R@ age'  is  analogous 
to  Pascal  or  Ada's  'i?.age'.  Next  we  will  consider  how  records  can  be  manipulated  using 
the  relational  operators. 

Notice  that  if  D  is  a  record  of  default  values  (say,  for  a  personnel  record)  and  R  is  a 
record  providing  values  for  only  some  of  the  fields  of  a  personnel  record,  then  R,D  is  a 
complete  personnel  record  with  defaults  from  D  provided  for  the  unspecified  fields  of 
R.  If  R  and  S  are  records  with  disjoint  selectors  (or  with  overlapping  selectors  whose 
values  agree)  then  RuS  is  a  join  or  combination  of  these  two  records.  Finally,  if  .S  is  a 
set  of  selectors,  then  S  -»R  is  a  subrecord  of  R  containing  only  the  fields  whose  selec¬ 
tors  cire  in  S.  For  example, 

{age,  salaryj -*/?  =  {  age:  40,  salary:  40000  ! 

12.2  functional  records 

A  common  situation  is  to  apply  the  same  function  /  to  every  field  of  a  record  R .  For 
example,  we  might  want  to  negate  the  coordinates  of  a  two-dimensional  point 
P  =  {X:10,Y:30J.  This  is  easily  accomplished  by  [0-].F.  Therefore  P's  Y  coordinate  is: 

[0-].P  ®  Y  =  [0-](PY)  =  [0— ](30)  =  0-30  =  -30 
In  general,  we  can  see  that  the  p  field  of  f.R  is  /  ( R<p) :  f  .R@ <p  =  /  {Ry). 

Now  suppose  that  we  have  a  record  F  whose  fields  are  functions  / 1,  f  z . fn' 

F  =  \<Pl'f  1.  <Pz’fz . <Pn'fn\ 

We  want  to  compute  a  record  R  that  has  the  same  shape  as  F,  but  with  fields  whose 
values  eire  /tx,  for  a  given  x : 

R  =  \<Pl  flX'  . <Pn'fnx\ 

Therefore,  for  any  selector  <p, 
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R<p  -  Ftpx  -  ( Ftp)@x  =  [@x](Fcp)  =  [@z].F 

Hence,  R  =  [@z].F.  We  define  6  to  be  the  application  of  a  functional  record  to  an  argu¬ 
ment,  F$x  =  @x.F.  Notice  that  Fi  is  the  function  derived  from  the  functional  record 
F.  Further  applications  are  discussed  in  §14,  on  arrays. 

We  have  seen  how  f.R  applies  a  function  to  a  record  argument  to  yield  a  record 
result  and  Fix  applies  a  functional  record  to  an  argument  to  yield  a  record  result. 
Next  we  will  investigate  the  application  of  a  functional  record  to  a  record  argument  to 
yield  a  record  result.  In  the  simplest  case  F  and  R  are  the  same  shape  and  we  want  to 
apply  corresponding  elements  of  F  to  corresponding  elements  of  R  to  yield 
corresponding  elements  of  the  result.  Thus,  if  we  let  S  be  the  result  record,  then  for 


any  field  <p  \ 


Sffi  =  (F<p)@{R<p)  =  (FeR)tp 


using  the  meta-application  operator  ®.  Hence,  S  =  FoR.  Therefore,  we  can  apply 
corresponding  elements  of  F  to  corresponding  elements  of  R  by  FoR. 

For  an  example  of  this  operation,  suppose  that  we  have  the  personnel  record  R 
defined  in  §12. 1  and  that  we  want  to  compute  a  new  record  S  in  which  the  age  field  of  R 
has  been  incremented  and  in  which  the  salary  field  has  been  increased  by  10%.  We  can 
accomplish  this  by  S  =  FqR,  where 

F  -  (name:  Id,  age:  1  +  ,  salary:  l.lx,  hire-date:  Id] 

A  common  situation  is  to  update  one  field  and  leave  the  rest  unchanged.  The  R  record 
with  its  age  field  incremented  is  just  [age,l+;  Kid]©/?. 


We  next  consider  a  generalization  of  meta-application:  the  outer  product  of  a  func¬ 
tional  record  and  its  argument  record.  Suppose  we  have  a  record  F  of  functions  and  a 
record  R  of  arguments;  the  records  F  and  R  are  not  assumed  to  have  the  same  shape 
(i.e.,  the  same  domain  members).  We  define  S  =  outer FR,  the  outer  product  of  F  and 
R  to  be  a  record  with  the  same  shape  as  F,  each  of  whose  fields  has  the  same  shape  as 
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R.  That  is,  if  95  is  a  field  selector  of  F  and  ^  is  a  field  selector  of  R ,  then  Sp  is  a  record 
in  which  Spij/  is  the  result  of  applying  Ftp  to  Ry.  That  is,  Stp  =  {Fp).R,  since  (Fp).R 
applies  F<p  to  each  field  of  R  and  forms  a  record  of  the  results.  Therefore, 
Sp  =  (.R){Fp)  =  .R.Ftp.  This  yields  the  definition  of  the  outer  product: 
R.F  =  outer FR.  Further  applications  of  this  operator  will  be  discussed  in  §14,  on 
arrays. 

EXERCISES:  Define  an  outer  product  that  yields  the  transpose  of  this  result.  That 
is,  Spyp  ~  {Fy){Rtp) 

12.3  relational  databases 

Next  we  consider  databases  composed  of  record-sets  and  define  functions  that  are 
analogous  to  the  relational  operations  of  Codd  [Codd70],  Let  D  be  a  record  set  whose 
elements  have  the  selectors  {name,  age,  hire-date,  salary};  D  might  represent  part  of 
an  employee  database.  Observe  that  if  /  is  any  operation  applicable  to  a  record  then 
img/  is  a  corresponding  function  applicable  to  the  entire  record  set. 

For  example,  to  form  a.  projection  composed  of  just  the  age'  and  'salary'  fields  of  D 
we  write  img[{age, salary}-*]/?.  To  compute  D'  in  which  every  employee  in  D  has  been 
given  a  10%  raise,  we  can  write 

D'  =  img  [({salary:  1. lx};  Kid)©]/? 

In  other  words,  we  are  applying  a  function  to  each  record  in  D\  this  function  multiplies 
the  ’salary'  field  by  1.1  and  leaves  the  other  fields  intact. 

Often  we  want  to  choose  some  selector  tp  of  the  records  in  D  to  be  a  key  and  gen¬ 
erate  a  function  F  from  D  such  that  Fk  is  the  record  in  D  whose  tp  field  is  k .  We  write 
this  F  =  index?/?.  Observe: 

t  -  Fk  <»  rp  =  k  A  r eZ? 

r@p  =  k  A  re/? 

<=>  [@p]r  =  k  A  re/? 
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r  =  [@?]  ‘A:  A  re/? 
o  r  =  ([@?]-1«-Z?)fc 

Hence,  /*  =  [@?]-1«-Z?,  so  we  define  index?/?  =  [@? ]_1«-/?. 

Another  common  operation  is  selection.  For  example,  suppose  we  want  P  to  be  the 
set  of  all  records  in  D  whose  'age'  field  is  greater  than  or  equal  to  65.  The  first  step  is 
to  index  the  set  on  the  age  field:  A  =  index  age  D .  Notice  that  xAr  if  and  only  if  record 
r  from  D  has  an  age  field  equal  to  * .  We  can  think  of  A  as  a  multiple-valued  function 
that  takes  ages  into  the  records  having  those  ages.  Thus,  if  we  apply  imgA  to  a  set  of 
ages  then  we  will  get  a  set  of  all  the  records  that  have  ages  in  the  given  set.  Clearly, 
then 

P  =  imgA(alfe65)  =  img[index  age  Z?](alte65) 

This  leads  to  a  general  definition  of  the  selection  function: 

select?/?  =  img[index?Z?] 

Hence,  select?  =  img. (index?),  so  select  =  (img.). index.  With  this  definition  of  select 
we  can  write 

select  age  D  (alfe65) 

to  select  all  those  records  whose  age  is  greater  or  equal  to  65. 

Finally,  we  consider  the  join  of  two  record  sets  D  and  E,  join?(/?,jE’).  This  is  com¬ 
posed  of  of  records  formed  by  combining  all  those  records  from  D  and  E  whose  ?  fields 
are  equal.  To  accomplish  this,  first  index  D  and  E  on  their  ?  fields:  F  -  index?/?, 
G  =  index?# .  Let  k  be  any  value  of  the  field  ?;  observe  that  (F||G)fc  is  a  pair  (d,e) 
where  de/?,  e  e#  and  d  and  e  both  have  their  ?  fields  equal  to  k.  Therefore,  we  want 
due  to  be  in  the  join.  The  set  of  all  such  pairs  (d,e)  is  just  the  range  (dom.inv)  of  the 
relation  F\\G.  Tlierefore,  to  get  the  join  J  we  must  apply  the  union  operation  to  every 
record  pair  in  the  range  of  F||G: 


J  =  imgu(dom.inv[F||G]) 
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This  is  the  definition  of  the  join  operation.  We  can  factor  D  and  E  out  of  the  definition 
thus: 

\ain<p{D,E)  =  [imguj.dom.inv /’ilG 

=  [ungu].dom.inv[index^Z?||index^£'] 

=  [imgu].dom.inv.||.(index^Z3,index^£') 

=  [imgu].dom.inv.||.[indexp  ||  index^](Z?,£') 

Therefore, 

join$p  =  [imgu].dom.inv.||.[indexp  ||  indexp] 

EXERCISES:  Factor  <p  out  of  the  definition  of  join. 

13.  Ancestral  Relations 
13.1  definition 

Carnap  [Carnap58]  defines  t,he  relation  of  a  property  p  being  hereditary  with 
respect  to  a  relation  r : 

p  Her  r  Van/ jiepAiry  o  y ep { 
o  img[r-,]p  cp 

This  leads  to  the  definition  of  the  ancestral  of  R  of  the  first  kind  as  that  relation  which 
preserves  all  the  hereditary  properties  of  R.  This  is  also  called  the  reflexive  transitive 
closure  of  R  . 

xR*y  xMmr  A  ^[p  Her  Z?  A  a:  ep  :>  y  ep] 

For  example,  if  xPy  means  that  x  is  a  parent  of  y ,  then  xP*y  means  that  x  is  an  ances¬ 
tor  (or  the  same  as)  y.  The  ancestral  of  the  second  kind  or  transitive  closure  is  also 

useful: 

R+  =  R*\R  =  R.R* 

Ihus,  P*  means  'ancestor'  in  the  colloquial  sense.  The  easiest  way  to  visualize  the 
meanings  of  the  ancestrals  is  by  their  expansion  as  infinite  unions: 
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R*  =  R°  u  Rl  u  R*  u  R3  u  ■  ■  • 

R*  =  1  u  Rz  u  /?3  u  tf4  u 

EXERCISES:  Here  are  some  useful  properties  of  the  ancestrals.  Prove  them. 

R+  =  R\(=)  =  R*\R° 
xR*y  3n,[n^0  A  xRny] 

R°  qR* 

R™  c  /?*,  for  n»0 
i?"  C  /?+.  for  n>0 
=  R* 

R+  C  R * 

/?*  = 

=  (JT1)* 

=  (AT1)* 

(rrs)*  c  r'ts 

Ancestral  relations  are  always  transitive.  Notice  that  <-  and  <  for  integers  can  be 
defined: 

*  =  (1+)' 

<  -  d+r 

That  is,  x<,y  means  that  y  can  be  reached  from  x  by  zero  or  more  applications  of  the 
successor  function  (1+).  The  ancestral  "fills  out”  all  of  the  paths  in  a  structure.  For 
instance,  if 


R  —  O.  i  02  Og  04 

—  -  M  >1  *• 


then 
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13.2  appiicatiana 

Suppose  that  S  is  a  sequence  and  we  wish  to  find  the  first  member  of  5  which 
satisfies  some  property  P.  First  form  the  closure  S’4’,  so  that  for  any  two  members  of 
S*  we  can  tell  which  is  first.  Next,  eliminate  from  S+  any  members  that  do  not  satisfy 
P:  S*tP.  Then,  a(S+tP)  is  the  first  member  of  S  satisfying  P. 

Next  we  will  consider  a  simple  character  manipulation  example:  stripping  leading 
blanks  from  a  string.  Note  that  x  (y  cl)*  z  means  that  z  is  a  result  of  consing  0  or 
more  y’s  on  the  front  of  x.  Hence,  z  [(y  cf)*]-1  x  means  that  z  is  the  result  of  strip¬ 
ping  one  or  more  y 's  from  the  front  of  z .  To  get  the  desired  result  it  is  only  necessary 
to  restrict  the  left  domain  of  this  function  to  be  sequences  that  don’t  begin  with  a  y. 
Suppose  Y  is  the  property  of  beginning  with  ay: 

xeX  o  y=a*  o  zay  «=>  x  e  allay 

Therefore,  the  function  to  strip  leading  y’s  from  a  sequence  is: 

[(y  cl)*]  *  *-  ~  (alla)y 

13.3  iteration 

Before  we  leave  the  topic  of  ancestral  relations,  it  will  be  useful  to  investigate  their 
use  as  a  means  of  iteration.  Suppose  that  F  is  a  function  (i.e.,  right  univalent).  Then, 
since 

F*  = 

we  will  have  xF*y  if  and  only  if  for  some  n>0,  y  =  Fnx .  In  general  there  may  be  many 
such  n,  so  F*  may  not  be  a  function.  If  F*  is  to  be  a  function,  it  is  necessary  to  pick  a 
termination  condition  (a  class)  that  is  only  true  for  one  of  Flx,  F®z,  F 3x Therefore 
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consider  the  relation  P*«-~.domP.  Let  D  —  ~.domP  to  see  the  effect  of  this  function: 

F**-D  =  (FiuFzuFsu  ■  ■  ■  )*-D  =  (F*-D  u  Fz*-D  u  F**-D  u  •  •  •  ) 

Then  ( F**-D)x  is  P”x  where  n  is  the  unique  n>0  such  that  F*x  is  defined  but  Fn*'ix  is 
not.  This  n  is  unique  because  Fn*xx  undefined  implies  that  for  all  m>n  F™ x  is 
undefined.  This  leads  to  the  definition  of  iter  F: 

iter  F  =  P+«-~.  dom  F 

Notice  that  iter[P-*P]  will  iterate  the  application  of  F  so  long  as  its  argument  satisfies 
P  (and  is  in  the  domain  of  F).  Since  it  always  applies  F  at  least  once  it  is  not  like  a 
while  loop;  the  equivalent  of  the  while  loop 

while  -'P  do  F 

is  iter[P-*P];Id,  since  any  input  not  in  P  n  dom/’  will  be  passed  through.  Hence  we 
define  while[P,P]  =  iter[P-»P];ld.  Analogously.  F|while[P,P]  is  equivalent  to 

repeat  F  until  -P 


14.1  definition  and  basic  operations 

An  array  is  just  a  function  from  a  contiguous  subset  of  the  integers  to  some  set  of 
values.  If  A  is  an  array  and  i  e  dom  A  then  A(i)  is  the  i-th  element  of  A.  Similarly,  if 
/  C  dom  A  is  a  set  of  index  values  then  imgA/  is  the  corresponding  set  of  array  values 
and  I-*A  is  the  subarray  of  A  selected  by  those  indices. 

It  is  easy  to  define  multi-dimensional  arrays:  they  are  just  arrays  whose  elements 
are  selected  by  sequences  of  integers,  e  g.  If  A#  is  a  two-dimensional  array, 

then  M.  (i.)  is  the  i-th  row  of  M  and  U.  ( j)  is  the  j'-th  column  of  M.  Also,  if  7  is  a  set  of 
row  indices  and  7  is  a  set  of  column  indices  then  /x/  -»  M  is  the  submatrix  of  M 
selected  by  these  sets.  It  is  easy  to  see  that  M.  inv  is  the  transpose  of  M ,  since 


Af.  in =  A/[inv(i,,7')]  = 
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More  generally,  if  P  is  a  permutation  function  (i.e.  a  bijection  from  an  index  set  into 
itself)  then  A.P  is  the  result  of  permuting  A  by  P. 

APL-like  array  and  matrix  operations  are  easy  to  express  with  the  relational  opera¬ 
tors.  For  example,  if  A  is  an  array,  then  f.A  is  the  array  resulting  from  applying  /  to 
every  element  of  A.  This  follows  from  the  definition  of  composition,  (f  A)i  =f(Ai). 
Hence,  sin. A  applies  sin  to  every  element  of  A.  Conversely,  if  F  is  an  array  of  func¬ 
tions.  then  Fix  is  an  array  of  results  obtained  by  applying  each  element  of  F  to  x. 
That  is,  (Fix)i  =  ( Fi)x .  Also,  if  F  is  an  array  of  functions  and  A  is  an  array  of  argu¬ 
ments,  then  FoA  is  an  array  of  results  obtained  by  corresponding  elements  of  F  to 
corresponding  elements  of  A.  This  follows  from  (F«A)i  =  Fi  @  M. 

Note  that  if  A  and  B  are  two  arrays  with  the  same  domain,  then  ATB  is  the 
element-wise  sum  of  these  two  arrays.  To  see  this,  suppose  that  C  =  ATB  and  consider 
an  arbitrary  element  of  C : 

C  %  —  (ATB)i  ~  AL  +  Bi 

In  general,  if  rr  is  an  infix  binary  operation,  then  n  is  the  element-wise  extension  of  that 
operation  to  arrays.  If  /  is  any  binary  function,  then  /.  (A~B)  is  the  element-wise 
application  of  it  to  arrays  A  and  B . 

The  same  approach  works  for  matrices  and  arrays  of  higher  dimensionality.  Sup¬ 
pose  that  M  and  N  are  two-dimensional  matrices  with  the  same  domains.  Then, 
=  f[M(i,j)  ]and 

As  for  one-dimensional  arrays,  a  matrix  of  functions  can  be  applied  to  a  single  argu¬ 
ment  by  Mix,  and  a  matrix  of  functions  can  be  applied  to  a  matrix  of  arguments  by 
M@N. 

If  A  and  B  are  arrays,  then  C  =  /.  (A||i?)  is  an  outer  product  by  f  of  A  and  B,  since 
C(i,j)  ~  f(AL,Bj).  For  example, 
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x.([1..12]  ||  [1..12J) 

Is  a  12  by  12  multiplication  table.  We  can  also  form  an  outer  product  between  an  array 
of  functions  and  an  array  of  arguments.  If  F  is  an  array  of  functions  and  A  is  an  array 
of  arguments,  then  P  -  @.(F\)A)  is  a  matrix  in  which  P(i.j)  =  (Fi)(Aj). 

EXERCISES:  Prove  that  ®.{F\\A)  =  uncurry,  outer  F  A. 

Suppose  x  is  an  element  of  the  array  A  (i.e.,  for  some  i,  x=M).  Then  allA  x  is  the 
set  of  all  indices  for  which  x=Ai.  Therefore  we  can  find  the  index  of  the  first  occurence 
of  *  in  A  (i.e.  APL's  iota  operator)  by  min(alL4  x).  In  general,  if  P  is  some  property 
(i.e.  class),  then  imgA-1  P  is  the  set  of  indices  of  all  elements  of  A  that  satisfy  P.  A 
sorted  reflexive  sequence  of  these  indices  is  just  ^  t  imgA-,P 

14.2  relation  to  sequences 

It  is  easy  to  convert  arrays  to  sequences  and  vice  versa.  Suppose  all  the  elements 
of  A  are  distinct,  then  A-1  is  a  function  that  returns  the  index  of  an  element  of  A.  We 
want  to  define  a  sequence  5  such  that  xSy  if  and  only  if  x  preceeds  y  in  A,  i.e.  the 
index  of  x  is  one  less  than  the  index  of  y .  To  put  this  functionally,  we  want  to  define  S 
so  that  y=Sx  means  that  y  is  the  successor  of  x  in  A,  i  e..  that  the  index  of  y  is  one 
greater  than  the  index  of  x . 

y  -  Sx  o  A~ly  =  A~lx  +  1 
e*  A~ly  =  (l+).A-1x 
<=>  y  -  A.  (l+).A-1x 

Hence,  S  -  A  (1+).A-1.  Notice  that  this  is  just  the  image  of  the  (1+)  structure  under 
the  function  A-1:  S  =  A~X${1+)  (the  $  operation  is  discussed  in  the  next  chapter). 

Next,  we  will  consider  the  opposite  process,  converting  a  sequence  to  an  array. 
Suppose  we  have  a  sequence: 

S  —  On  Oi  Uo  O3 

»■  ■»» — ** 
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We  wish  to  convert  this  to  an  array: 


0 

o0 

1 

ai 

2 

a2 

3 

Og 

Thus,  for  each  element  in  the  sequence,  we  must  find  its  index  %  in  the  resulting 
array.  If  we  can  define  a  relation  R  such  that  /?(ot)=i  then  R~x  will  be  the  array  we 
seek.  Now  /?(at)  is  just  the  number  of  predecessors  of  04  in  S.  That  is,  a0  has  no 
predecessors,  so  f?(a0)  =  0;  o2  has  two  predecessors,  so  R{az)  =  2,  and  so  on.  Since  S 
defined  an  immediate  predecessor  relation,  S*  defines  an  ancestral  predecessor  rela¬ 
tion: 


Since  xSy  means  x  is  a  predecessor  of  y,  y=Sx  means  y  is  a  successor  of  x.  Thus  the 
set  of  successors  of  any  element  a  is  then  unimgS+a,  and  the  set  of  predecessors  of  a 
is  unimg.invS+a,  e.g. 

unimg.inv5+az  =  |a0,  a,} 

Alternately,  unimg.invS+a  =  allS+a  is  the  set  of  all  elements  that  bear  the  S+  relation 
to  a.  The  size  of  this  class  is  then  the  desired  index: 

size  (all5+ tig)  =  2 

Hence,  R(a)  =  size(allS+tx),  so  R  =  size.(all5+).  Now,  we  know  that  A  is  R1,  so  we  can 
define  the  function  saO  which  converts  a  sequence  into  a  0-origin  array: 
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saO  S  =  [size. (allS*)]-1 

To  produce  a  1-origin  array,  the  only  alteration  is: 

saS  =  [size,  (alls*)]-1 

14.3  other  array  operations 

Next  we  will  consider  the  concatenation  of  arrays.  If  A  is  an  array  such  that  Ai  =  a*, 
then  we  can  write  A  : 

A  =  { 1 : a i ,  2:aa . m:^] 

where  m  is  the  length  of  the  array.  Similarly,  suppose  that  B  is  an  n  element  array, 
then  the  concatenation  of  these  arrays  is 

A  cat  B  =  $l:alP  ....  m.a^]  u  [m  +  l:bj,  ....  m+n:6nj 

We  can  see  that  A  cat  B  =  AuB'  where  B'  results  from  B  by  shift  its  indices  by  m: 

B'  =  +  . m+n:b„] 

How  do  we  compute  S’?  Observe: 

B'i  =  =  B[(—m)i]  =  B.(-m)i 

Hence.  B'  =  B.  (—  m)  and  A  cat  B  =  A  u  B.  (— m),  where  m  is  the  length  of  A.  The 
length  of  A  is  just  size.dom  A,  so 

A  cat  B  =  A  v  B.  (-size.dom  A) 

We  will  finish  our  discussion  of  arrays  by  investigating  the  generation  of  sorted 
arrays.  Let  5  be  a  set  of  integers  to  be  sorted,  then  [^tS]  is  a  structure  which  relates 
lesser  elements  to  greater  elements.  Now  if  x  is  any  element  of  the  set,  all[^T5]x  is 
the  set  of  all  elements  less  or  equal  to  than  x.  Thus  size(all[^t5]x)  =  size,  (all  S)x  is 
the  number  of  elements  of  S  less  than  or  equal  to  x.  This  is  just  the  index  of  x  in  the 
sorted  array  we  seek.  Hence  if  A  is  the  sorted  array,  iAx  if  and  only  if 
x[size.(all  stS)]i,  so  A  =  [size. (all  ^TS)]-1.  Of  course  this  can  be  generalized  to  any 
ordering  relation. 
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15.  Isomorphic  and  Homomorphic  Images 
15.1  images 


Consider  any  relation  R  and  any  biunivalent  function  /  .  If  we  take  each  node  n  of  R 
and  replace  it  by  fn  we  get  a  relation  closely  related  to  R  called  the  image  of  R  under 


Figure  13.  Image  of  a  Relation 

It  is  easy  to  define  f  SR.  Observe  that  if  S  =  f  SR  then  (fx)S(fy)  just  when  xRy . 
Conversely  u9v  whenever  there  are  x  and  y  such  that  xRy ,  u  =/x  and  v=fy.  Hence, 

uSv  <=>  3cy[xRy  /\u=fx  /\v=fy] 
o  3cy[xfu  A  xRy  A  yfv  ] 
o  Bey[uf~lx/\xRy/^yfv] 
u[f~l\R\f]v 

Hence.  fSR=f~1  \R\f  =  f  .R  f~l 


The  image  operation  is  also  useful  when  /  is  not  biunivalent.  For  example,  if  fb=fd 
then  /  SR  (with  the  R  in  Figure  13)  is: 


fe  fb=fd 


I.e.,  we  merge  the  nodes  corresponding  to  b  and  d. 

The  S  operation  is  clearly  related  to  the  img  operation  —  they  both  compute  the 
image  of  a  structure.  Since  #.[/  ||/].un  x.y  =  (/x):(/y),  we  have  this  relationship 
between  the  images  of  relations  and  sets: 

fSR  =  img(d.[/||/].un)ff 
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That  is.  ft-  img(tJ  [/I!/ ].un). 

The  image  operations  have  many  uses.  For  example,  since  [l..n]  =  (1,2 . n),  we 

can  see  that 

(m+)J[l..n]  =  (m.  +  l,m+2,  .  .  .  ,  m+n) 

Hence  the  identity  [m  +  l.m+n]  =  (m+)J[l..n].  To  compute  a  list  of  the  powers  of  two 
from  2°  to  2,#  we  write  (2t)J[0  .16],  where  xty  =  xv .  Finally,  to  compute  a  list  of  the 
sines  of  the  angles  from  0°=0  rad.  to  90 °=n/  2  rad.  we  write 

sin.(xrr/  1B0)  S  [0.  .90] 

To  see  that  this  works: 

sin.(xrr/ 100)  S  (0,1 . 90) 

=  (  sia(xtr/  180)0,  sin.(x7r/ 180)1,  ....  sin.(xtr/  180)90  ) 

=  (  sin(0xrr/ 180),  sin(lxir/  180) . sin(90xn/  180)  ) 

=  (  sin  0°.  sin  1° . sin  90°  ) 

EXERCISES:  Show  that  inv  =  [d.inv.un]S. 

15.2  images  of  functional  structures 

We  have  seen  how.  given  a  function  /  and  a  relation  of  values  V  we  can  form  a  rela¬ 
tion  /  SV  in  which  the  shape  of  V  is  the  same  as  the  shape  of  /  SV  and  each  member 
v  ememV  corresponds  to  Jv  in  /  IV.  Now  we  will  address  the  converse  problem:  given 
a  relation  of  functions  F  and  a  value  v ,  how  can  we  construct  a  relation  F\ v  such  that 
the  shape  of  F  is  the  same  as  the  shape  of  F\v  and  each  member  /  ememF 
corresponds  to  Jv  in  F\v.  This  is  clearly  the  image  of  F  under  some  unknown  function 
<p\  FI v  -  tpSF.  We  will  solve  for  <p.  Observe  <pf  =  Jv  =  f@v  =  (@v)f .  Hence  <p  -  (@u) 
and  F'.v  =  (Qv)SF.  That  is,  F\v  is  the  image  of  F  under  the  operation  'apply  to  v'.  Yfe 
can  eliminate  v  from  this  definition: 

( F\)v  =  FW  =  (@t j)SF  =  (W)(Ou)  =  {SF).@  v 
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Therefore  FI  =  (SF).@ .  Notice  that  the  FI  is  a  function  derived  from  a  functional 
structure  just  as  F&  is  a  function  derived  from  a  functional  record. 

We  now  consider  some  applications  of  this  operation.  To  form  a  sequence  by  apply¬ 
ing  each  of  a  sequence  of  operations  to  the  same  argument  we  write,  for  example: 

(sin,cos,tan)!i$  =  (sintf,  cos  -d,  tani?) 

In  particular,  (/,p)!  is  just  f~g  and  Backus’  constructor  [f  ,g . A]  is  just  our 

[/■ff . Mi- 

Recall  our  previous  example  in  which  we  computed  the  sines  of  the  angles  from  0°  to 
89°  by 

sin.(xtr/ 180)  $  [0..B9] 

We  can  extend  this  to  compute  a  table  of  the  sines,  cosines  and  tangents  of  the  angles 
from  0°  to  89°  by  using  both  of  the  image  operations: 

(sin,cos,tan)!.(xiT/  180)  S  [0..89] 

This  produces  a  sequence  of  sequences  of  the  form 

((sin  0°.  cos  0°,  tan  0°).  (sin  1°,  cos  1°,  tan  1°) . (sin  89°.  cos  89°.  tan  89°)) 

In  general  F\SR  has  an  outer  structure  the  same  as  R's,  each  of  the  elements  of  which 
has  a  structure  the  same  as  F's.  Thus  it  is  sort  of  an  "outer  product"  between  F  and 
R  in  which  the  members  are  fr  for  /  Mm  F  and  r  Mm  R. 

To  convert  a  sequence  of  sequences  such  as  this  into  a  matrix  requires  an  applica¬ 
tion  of  the  sa  operator  at  each  level  of  structure.  Let  5  be  the  sequence  of  sequences. 
First  convert  each  of  its  elements  to  an  array  by  sa55,  Next,  convert  the  resulting 
sequence  to  an  array  by  sa[sa$S].  The  result  of  the  latter  operation  is  an  array  of 
arrays  that  can  be  converted  to  a  two  dimensioned  matrix  by  uncurrying.  Thus  the 
sequence  to  matrix  conversion  is 


ssm  5  =  uncurry. sa[sa55] 
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Therefore, 

ssm  =  sa S  |  sa  |  uncurry 

This  can  be  read:  To  convert  a  sequence  of  sequences  to  a  matrix,  convert  each  of  its 
elements  to  an  array,  convert  the  result  to  an  array,  and  uncurry  that  result. 

EXERCISES:  Define  an  outer  product  operation  PER  which  has  the  outer  structure 
of  F  but  the  inner  structure  of  R,  Thus,  the  matrix  corresponding  to  PER  is  the  tran¬ 
spose  of  the  matrix  corresponding  to  F\SR: 

(ssm  P^7?).inv  =  ssm (E\$R) 

15.3  isomorphism  and  the  structure  function 

Carnap  [Carnap58]  defines  two  relations  to  be  isomorphic  when  there  is  a 
biunivalent  relation  between  their  members  that  preserves  their  structure.  That  is,  R 
is  isomorphic  to  5: 

R*S  o-  3f  ebun [/?  =  /  55] 

Thus,  two  relations  are  isomorphic  if  one  is  a  biunivalent  image  of  the  other. 
Equivalently,  two  relations  are  isomorphic  if  their  arrow  diagrams  are  equivalent  when 
their  node  labels  are  removed.  The  isomorphism  of  sets  is  defined  in  the  same  way: 

S~T  <^>  3f  ebun[5  =  img/71] 

The  structure  of  a  relation  is  arrow  diagram  for  the  relation  with  its  node  labels 
removed.  For  example,  the  structure  of  R  in  Figure  13  is: 


Thus  two  relations  are  isomorpn  n  if  they  have  the  same  structure.  Mathematically  the 
structure  of  a  relation  is  just  the  set  of  all  relations  isomorphic  to  the  given  relation: 
str  R  =  \S  |  S^R\  =  all^/?.  Thus  str  R  is  an  equivalence  class  under  Alternately. 
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str  7?  =  iS|S=*7?j 

=  |S  |  3/  ebun[S=/  SR]\ 

=  img[f/?]bun 

That  is,  stri?  is  the  class  of  all  biunivalent  images  of  R.  Note  that  R^S  <=>  str/?=strS. 

The  structure  of  a  set  is  defined  in  exactly  the  same  way.  Since  Cimg SF  =  img FS , 
we  have 

str  5  =  $  T ]  T^Sl  =  all^S  =  img[CimgS]bun 

Observe  that  if,  following  Russell  and  Whitehead  [Whitehead70],  we  define  a  number  as 
the  class  of  all  classes  isomorphic  to  a  given  class,  then  the  size  of  a  class  is  just  the 
set  of  all  classes  isomorphic  to  that  class:  size  5  =  But  this  is  just  the 

definition  of  the  structure  of  a  class.  Hence  for  all  sets  5,  size  5  =  str  S.  In  other 
words,  the  structure  of  a  set  is  its  cardinality.  When  the  identity  of  its  elements  is 
ignored,  the  only  structural  characteristic  still  possessed  by  a  set  is  its  size: 

str( 1,8,2}  =  strfcat.dog.cowf  =  {•,•,}  =  3 


16.  Data  Structures 
16.1  definition 

Simple  relations  are  not  adequate  for  modeling  all  structures.  For  example,  sup¬ 
pose  we  write  this  sequence:  (1,2, 3, 2, 4, 5).  This  is  defined  to  be  the  relation 

\  1:2,  2:3,  3:2,  2:4,  4:5  } 

To  make  its  structure  more  apparent,  we  will  draw  this  as  an  arrow  diagram: 


R 


This  is  certainly  not  what  we  expected,  and  it  will  not  give  the  results  we  expect.  For 
example,  we  cannot  scan  through  this  "sequence"  because  R{ 2)  is  multiple  valued. 
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To  avoid  this  problem  it  is  often  better  to  use  data  structures  (or  interpreted  struc¬ 
tures).  A  data  structure  5  is  a  pair  ( D,R ),  where  R  is  a  relation  (a  simple  structure) 
that  defines  the  farm,  part  of  the  data  structure,  and  D  is  a  function  that  associates 
data  values  with  the  members  of  R\  it  is  called  the  data  part  of  the  data  structure. 
Usually  dom/7  =  mem R,  but  this  does  not  have  to  be  the  case;  we  will  see  examples 
later. 

The  structure  that  we  intended  by  writing  (1,2, 3,2, 4, 5)  can  be  correctly  represented 
by  a  data  structure  {D.R)  in  which  R  =  (a.b.c.d.e.f)  and 

27  =  {a:l,  b:2,  c:3.  d:2,  e;4,  f:5{. 

It  doesn't  matter  what  a,  b,  c,  d,  e,  f  are.  so  long  as  they  are  distinct.  We  will  write  data 
structure  sequences  with  angle  brackets;  <1,2,3,2,4,5>. 

16.2  operations  on  data  structures 

We  need  functions  for  both  interrogating  and  updating  data  structures.  The  data 
and  form  parts  of  data  structures  can  be  extracted  by  a  and  u.  respectively.  In  partic¬ 
ular,  if  n  is  a  node  in  S,  nemem(oS),  then  a  Sri  is  the  value  associated  with  that  node. 
A  common  situation  is  to  inquire  the  value  of  a  node  selected  by  applying  a  function  / 
to  the  form  of  a  data  structure;  we  write  this  v/S.  For  example,  vaS  is  the  value  of 
the  first  element  of  S  and  v{uS)S  is  the  value  of  the  second  element  of  S.  In  general, 

vf  {D.R)  =  D{f  R)  =  D@  JR  =  @{D,fR)  =  @.  [Id|i/  }(D.R) 

Therefore,  vf  -  [Id||/]  and  v  =  (@.  ).(ld||). 

Next  we  define  operators  <p  and  6  that  alter  their  argument  function  so  that  it 
operates  on  either  the  form  or  the  data  part  of  a  data  structure,  but  leaves  the  other 
part  unchanged.  That  is,  <pf  {D.R)  =  {D.fR)  and  <5/  {D,R)  =  {fD,R).  Therefore 
tpf  =  Id||/  and  6f  ~  f  ||ld,  so  y  =  ld||  and  <5  =  j|Id. 

We  will  define  an  operation  n  such  that  IT/ S  is  the  image  of  the  structure  5  under 
the  function  / ,  that  is,  UfS  is  a  structure  with  the  same  form  as  5  but  with  values 
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derived  by  applying  /  to  the  data  of  S.  Thus  T\f  R  is  the  analog  for  data  structures  of 
f  SR  for  relations  and  f.R  for  records  and  arrays.  Suppose  S  =  ( D,R )  and 
IT \fR  =  ( D',R ).  For  any  n  emem/f  we  must  have  D'n  =  /  {Dn ),  so  D’  -  f  D  -  [f.]D. 
Hence,  we  get  UfS  from  5  by  applying  [/.  ]  to  the  data  part  of  S.  so  FI/5  =  6[f.  ]S, 
and  Uf  =  6[f.  ].  For  example,  if  5  is  any  data  structure  whose  values  are  numbers, 
then  n[l+]5  adds  one  to  each  element  of  the  data  structure. 

The  n  operator  leaves  the  form  of  the  data  structure  unchanged;  next  we  consider 
operators  that  reform  data  structures.  First  we  define  operators  that  filter  a  data 
structure  by  removing  some  of  its  nodes.  In  the  simplest  case  we  just  throw  away  the 
nodes  we  don't  want,  only  retaining  those  that  satisfy  a  given  property  P.  Hence, 

(D,R‘)  =  (D.RrP)  =  {D.[*P]R)  =  y[tP](D.R) 

Hence  <p\fP]  filters  a  data  structure  by  eliminating  all  those  nodes  that  do  not  satisfy 
P.  Suppose  that  we  want  to  eliminate  the  negative  nodes  of  a  data  structure.  Thus  we 
want  x eP  o  aSVi3tO  <=>  n  (aS)  |ss  0,  so  P  =  all(a5  |S:)0. 

This  simple  form  of  filtering  will  often  lead  to  nodes  becoming  isolated.  That  is,  if  we 
filter  the  sequence 

<  3,  4,  -2,  6,  7,  -1,  2,  -4  > 
by  the  set  P  =  all(a5 1^)0  then  we  will  get 

3  *4  6  V  2 

Note  that  the  node  whose  value  is  2  (a  positive  number!)  is  not  even  in  the  relation 
anymore  since  it  has  no  neighbors  (it  is  still  in  the  data  mapping,  however).  Usually  we 
would  prefer  to  connect  up  the  remaining  elements  of  the  sequence,  yielding 
<3,4,8,7,3>.  How  can  this  be  accomplished? 

We  will  define  an  operator  $  such  that  $PS  is  the  data  structure  resulting  from 
filtering  the  data  structure  S  by  the  predicate  P.  Suppose  S  =  (D,R)  and 
iPS  =  ( D,R ’).  A”  will  be  derived  from  R  by  adding  some  new  pairs  to  RiP,  In 
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particular,  we  want  to  add  just  enough  pairs  to  directly  connect  those  nodes  that  were 
indirectly  connected  in  R  but  are  not  indirectly  connected  in  RrP.  We  will  call  this 
operation  so  /?’  =  $R. 

Observe  that  xR*y  if  and  only  if  y  is  reachable  from  x  in  one  or  more  steps.  Simi¬ 
larly  x(R  |/?+)y  if  and  only  if  y  is  reachable  from  x  in  two  or  more  steps.  Therefore, 
first  take  our  original  relation  R  and  compute  R*: 


Then  eliminate  the  undesirable  members  by  restriction  S  =  RtP: 


There  are  clearly  many  redundant  edges  here.  We  want  to  eliminate  any  edges  that 
can  be  generated  from  the  others;  that  is,  we  want  a  minimal  set  of  edges.  Since  5  |  S* 
are  all  the  edges  of  length  two  or  greater,  these  are  the  redundant  edges; 


If  we  delete  these  edges  from  S  we  will  have  only  the  nonredundant  edges  left,  so 
S\(S|S+)  is 


3  4  6  7  2 


We  can  now  define  f .  First  we  define  a  useful  operation  n  that  minimizes  a  relation 
by  eliminating  all  of  its  redundant  edges;  fiR  =  R  \  R\R* .  To  see  that  this  works  just 
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expand  the  transitive  closure: 

fiR  =  R\R\R+ 

=  R  \P|(PluP2uP3u  •  •  •  ) 

=  R  \  (R2uR3uR*  •  •  •  ) 

=  R\R*\Ra\R*\ 

Hence,  to  filter  a  relation  R  by  a  predicate  P  we  use  ^[R¥rP\  Therefore, 

IPR  =  R’  =  n[R*rP] 

=  /z.[fP][trac/?] 

=  |i.[tP].trac  R 

where  we  have  used  trac  R  =  R*.  Hence  we  have  that 

£P  =  /x.  [tP].trac 

Notice  that  this  definition  is  really  quite  readable.  It  says,  "To  filter  a  relation,  com¬ 
pute  the  transitive  closure  (trac),  eliminate  undesirable  nodes  [tP],  and  eliminate 
redundant  edges  (At)." 

We  now  want  to  extend  (  into  the  operation  $  on  data  structures.  Recall  that  $PS 
means  that  a  node  is  to  be  included  in  the  result  only  if  its  value  satisfies  P.  Hence,  if 
S  =  {D,R)  then  we  want  to  filter  R  by  F  where  neP  if  and  only  if  PneP.  Now,  the  set 
of  all  nodes  whose  value  is  in  P  is  just  the  inverse  image  of  P  under  D,  F  =  img.invPP. 
Therefore,  we  want  to  filter  R  by  img.invPP,  which  we  do  by  ((img.invPP)/?.  Hence, 
$P{D,R)  =  ( P ,  ([img.invPPjP).  We  can  factor  ( D,R )  out  of  this  equation: 

iPS  =  $P(P,/?) 

=  (P,  ([img.invPP]P) 

=  (P,  ([(@P).img.invP]P) 

=  (P.  (. (@P).img.invP  R) 

=  (P,  uncurry[(.(@P).img.inv](P,/?)) 

=  ( aS ,  uncurry[(.(@P).img.inv]S) 
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=  (aTuncurry[f.(®P).img.inv])5 
Therefore, 

=  a7uncurry[f.(@P).img.inv] 

17.  Reducing  Structures 
17.1  bale  concepts 

In  this  section  we  will  discuss  several  methods  for  reducing  structures,  that  is,  for 
applying  a  function  to  each  element  of  a  structure  and  accumulating  the  results.  Since 
no  one  method  has  yet  been  selected,  this  section  should  be  taken  as  a  report  of  work 
in  progress. 

A  general  paradigm  for  processing  a  structure,  such  as  a  file,  is  the  following: 

1.  Perform  some  initialization. 

2.  Read  the  next  (or  first)  element  of  the  file. 

3.  Take  this  value  and  the  results  of  processing  the  previous  values. 

4.  Process  these  to  yield  new  cumulative  values  and  continue  from  step  (2). 

5.  When  the  end  of  the  file  is  reached,  return  the  accumulated  result  of  processing  all 
of  its  elements. 

A  simple  form  of  this  appears  in  APL’s  reduction  operation: 

+/7  =  K»+(  -  •  (Pn-l+Vn)  •  ) 

A  more  general  form  is  Backus'  insert: 

/  J  =  f  :<s?j,...  f  :<xn-i,xn>...> 

Our  first  example  of  scanning  structures  will  be  to  express  this  operation  in  the  rela¬ 


tional  calculus. 
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17.2  reduction  of  arrays 

We  are  given  an  n  element  array  A  and  wish  to  compute: 

t  =  y4(n)+A(n— 1)+  •  •  -k<4(2)+/4(l) 

where  we  have  assumed  that  the  domain  of  A  is  We  saw  in  the  section  on  ances- 

trals  (§13)  that  iter[~T  -»  F]  will  iterate  the  application  of  F  with  T  used  as  the  termi¬ 
nation  condition.  Consider  how  the  analogous  loop  would  be  written  in  Pascal: 

S  :=  0;  i:=0; 
while  i*n+l  do 

begin  S  :=  S+A[i];  i  :=  i+1  end 

On  each  iteration  two  functions  are  performed:  S  is  increased  by  A[i]  and  i  is  incre¬ 
mented  by  1.  Let's  represent  the  state  of  the  computation  by  a  pair  (s,i),  where  s  is 
the  cumulative  sum  so  far  and  i  is  the  index  of  the  next  element  to  process.  We  will 
use  F  to  represent  one  processing  step,  so  that,  if  (s'.i')  is  the  new  state,  we  can  solve 
for  F  as  follows: 

F(s.i)  =  ( s'.i ') 

=  (s+Ai,i+l) 

=  (+0.ifc],  [l+]i) 

=  (+.[Id||A](s,i),  [l+].u(s,i)) 

=  (+.[Id|M]71+.«)(s,i) 

Hence,  F  =  (+.[ld||i4]7  l+.u). 

It  remains  to  determine  the  termination  condition,  T.  If  x  is  a  state,  i.e.,  a  pair 
(s,i),  then  xzT  when  i=n  +  l.  Hence,  xeT  when  ox  =  n+1,  so  T  is  the  set  of  all  states 
mapped  by  «  into  n  +  1.  Hence,  T  =  all  «n  +  l.  The  final  state,  xj ,  containing  the  sum 
is  iter[~7’  -*  Fjxt,  where  a*  =(0,1)  is  the  initial  state: 

Zf  =  iterf^T  -*  F](0,1) 

Now,  the  total  t  is  just  <xxf ,  so 
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t  =  a.iter[~T -»  FK0.1) 

We  can  generalize  this  to  any  function  /  with  initial  value  i : 

t  =  a.iter[~7*  -»  f](i,l) 
where  F  =  (/.  [Id|]i4]7  l+.w) 
and  T  -  all  cj  (1+sizeA) 

This  result  can  be  improved  by  directly  extracting  the  result  from  the  fined  state. 
That  is,  we  want  to  define  a  filter  <p  such  that  t  =  <p.F*(i,  1).  Hence  we  want  Xj<pt,  so 
Xj<pt  Now,  note  that  [,n+l]f  =(f,n  +  l),  so  t [,n+l](f ,n  +  l)  by  the 

definition  of  application.  Therefore  <p  =  [,n  +  1]-1  and  we  have  the  simplified  formula 
t  =  [,n+l]_1.F#(i,l).  This  leads  us  to  the  following  definition  of  the  array  reduction 
operation: 

(/*i)A  =  [,n  +  l]-|./’*(t,m) 
where/*  =  (/,[Id||i4j71+.«) 
and  m  =  min(domA) 
and  n  =  max(dom  A) 

Therefore,  if  A  is  an  array  indexed  m  to  n,  then  (+J0)A  is  the  summation  of  A, 

t* 

i=m 

Using  this  operation,  the  inner  product  of  arrays  A  and  B  can  be  written  simply  as 
+$0(AX5). 

EXERCISES:  Show  that  +$0(AXi?)  is  the  inner  product  of  A  and  B. 

17.3  reduction  of  sequences 

Next  we  will  consider  the  scanning  of  sequences.  Suppose  5  is  a  sequence: 

S  =  (sj,Sg . sn,EOF) 

where  EOF  is  an  "end  marker";  it  can  be  any  value.  Now,  we  wish  to  find  the  result 
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ifSifsgf  •  •  •  /  sn 

that  is 

/(/(•  •  /(is.)  ■■■).*») 

for  some  function  /  and  starting  value  i.  The  state  can  be  represented  by  a  pair  (f  ,s), 
where  t  is  the  result  so  tar  computed  and  s  is  the  rest  of  the  sequence  to  be  pro* 
cessed.  Hence,  (t'.s')  =  F(t,s)  where  V  =  f(t.as)  and  s'  =  fls.  Therefore, 

F(t,s)  =  (t'.s')  =  (f[t .as],  Os) 

=  (/.  [Id||a](f  ,s),  0.«(f  ,s))  =  (/.  [Id||a]TO.«)(f  ,s). 

Hence,/*  =  /.  [Id||a]7n.«. 

What  is  a  terminal  state?  Notice  that  0(sn,E0F)  =  <f>,  so  a  terminal  state  will  have  the 
form  (r,$),  Thus  the  set  of  terminal  states  is  the  set  of  all  those  states  mapped  into  <f> 
by  a:  allu0.  Hence. 

r  =  while[~  allw0,  /*](i,5) 

To  put  this  in  a  more  useful  form,  we  will  define  a  function  /§i  such  that  r  =  (/  §£)5. 
This  is  simply 

/§i  =  while[~  allw0,  /.  (Id||ot)7 .  (i.) 

Then,  the  sum  of  the  elements  of  a  sequence  5  is  just  (+§0)5. 

18.  Examples 

In  this  section  we  will  give  several  examples  of  relational  programs. 

18.1  payroll 

Suppose  we  have  a  file  $  of  employee  records,  where  r  =  $>n  is  the  record  for  the 
employee  with  the  employee  number  n.  We  will  suppose  that  employee  records  are 
functions  defined  so  that: 
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rN  =  employee  name 

rH  =  hours  worked  so  far  this  week 

rR  =  pay  rate 

We  are  given  an  update  file  U  such  that  Un  is  the  number  of  hours  worked  by  employee 
n  today.  We  wish  to  generate  a  new  payroll  file  4’. 

SOLUTION:  Let  r  =  in  and  r'  =  i'n  be  the  old  and  new  employee  records.  It  is  clear 
that  r'  is  the  same  as  r  except  for  its  H  field.  In  order  to  modify  part  of  a  relation,  we 
will  use  the  conditional  union  (or  overlaying  operation)  defined  by: 

R,S  =  R  u  ~.dom/?  -»  S 

Then,  if  h'  represents  the  new  value  of  the  H  field,  the  new  employee  record  is 
r'  =  (H.h'),  r,  where  h'  is  just  the  cumulative  hours  worked.  h‘  =  $nH  +  Un.  Therefore, 
by  the  definition  of 

i'n  =  r'  =  (H.A'):  $n 

To  find  $’  we  must  factor  out  the  employee  number  n.  To  do  this,  note  that  $n.H  = 
[@H]($n)  =  [@H].$n.  That  is,  [@H].$  =  #®H  is  a  slice  of  the  payroll  file:  the  hours 
worked  for  each  employee.  Therefore, 

h'  =  $nH+  Un  =  [@H].$n  +  Un 
=  ($®H  T  U)n 

Now,  define  the  updating  function  u  by 

u(n)  =  [H,  (»HT  £/)n] 

=  [H,].($®H  T  U)n 

Then,  $’n  =  u(n);  in  =  [$Tu]n.  Therfore,  the  solution  to  our  problem,  the  new  payroll 
file,  is 


=  1/7$,  where  u  =  [H,].($6H  T  U) 
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18.2  check  iawning 

Suppose  we  wish  to  take  the  payroll  file  from  the  previous  example  and  generate 
checks  for  the  employees.  We  will  assume  that  a  function  C  is  available  such  that 
C(m,p)  returns  a  check  in  the  amount  p  made  out  to  the  name  m . 

SOLUTION:  We  will  ignore  overtime  computations.  Hence,  if  n  is  an  employee 
number  then  $nN  is  his  name  and 

p(n)  =  $nH  x  $nR 

is  his  pay.  Therefore  p  =  $6H  X  $6R.  Now  observe  that  his  check  c(n)  is 
c(n)  =  C(m,pn)  =  C($nNjm)  =  C($6N n.pn)  =  C.  ($®N7p)n.  Combining  these  we 
have  the  file  F  mapping  employee  numbers  into  checks: 

F  =  C.[$$N7($$Hx  $6R)] 

from  which  we  can  factor  out  the  old  payroll  file: 

F  =  C.  [6N7(6HX«R)].$ 

If  we  just  want  a  set  of  checks,  this  is  dom.invF. 

18.3  paeufkrniitunil  natation 

Relational  programs  can  be  made  less  intimidating  by  using  the  pseudo-natural 
notation  described  in  [MacLennan82].  This  notation  uses  words  in  place  of  symbols  and 
uses  a  comma  convention  to  suppress  many  parentheses.  The  frequency  table  pro¬ 
gram  from  §1,  F  -  size. (all  T),  can  be  written: 

'Freq-table'  means  all  text  then  size. 

Here,  'Freq-table'  =  F  and  'text'  =  T. 

The  payroll  example  looks  like  this  in  the  pseudo-natural  notation: 

'Updates'  means: 

Old-Master  slice  Hours,  each  add  Hours-Worked, 
then  pair-with  Hours. 
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‘New-Master’  means  Updates  each  replace  Old-Master. 

Here,  'Updates’  =  u,  ‘Old-Master’  =  #.  ‘slice’  =  6,  'Hours'  =  H,  'each  add'  =  T,  ‘Hours- 
Worked'  =  U,  'then'  =  |,  'pair-with'  =  tt,  'New-Master'  =  $',  and  ‘each  replace'  =7- 

The  check  issuing  example  is  also  easily  put  into  this  notation: 

‘Checks’  means 
Old-Master  then: 
something  slice  Name 

also  something  slice  Hours  each  times  something  slice  Rate, 
then  Write-check. 

Here,  ‘Checks’  =  F,  ‘something’  represents  an  omitted  argument,  'Name'  =  N,  'also*  = 
7,  'each  times'  =  x,  ‘Rate’  =  R,  and  'Write-check*  =  C. 

19.  Implementation 
19.1  introduction 

The  primary  goal  of  our  investigation  has  been  to  determine  if  relational  program¬ 
ming  is  significantly  better  than  conventional  methods.  It  would  be  premature  to 
devote  much  effort  to  implementation  studies  before  it  is  even  determined  if  relational 
programming  is  an  effective  programming  methodology.  However,  a  brief  discussion  of 
implementation  possibilities  is  probably  not  out  of  line. 

The  most  obvious  representation  of  a  relation  is  the  extensixmal  representation,  in 
which  all  the  elements  of  a  relation  or  class  are  explicitly  represented  in  memory. 
There  are  many  kinds  of  extensional  representations,  such  as  hash  tables,  binary  trees 
and  simple  sorted  tables.  Of  course,  performance  can  be  improved  through  the  use  of 
associative  memories  and  active  memories  (in  which  each  memory  cell  has  a  limited 
processing  capability). 

Some  relations  and  classes  will  be  so  large  that  it  is  uneconomical  to  represent 
them  explicitly  in  memory.  In  these  cases  an  intensional  representation 
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[MacLennan73]  should  be  used.  Here  a  class  or  relation  is  represented  by  a  formula  or 
expression  for  computing  that  relation  or  class.  Operations  on  the  class  or  relation  are 
implemented  as  formal  operations  on  the  expression.  This  is  feasible  because  of  the 
simple  algebraic  properties  satisfied  by  relations.  It  can  be  seen  that  an  intensional 
representation  is  really  just  a  variant  of  a  lazy  evaluation  mechanism  [Henderson76, 
HendersonBO].  Sometimes  an  intensional  representation  is  necessary;  for  instance, 
relations  of  infinite  cardinality,  such  as  the  numerical  operators  and  relations,  require 
an  intensional  representation. 

10.2  computability 

It  can  be  shown  on  theoretical  grounds  that  some  of  the  operators  we  have 
described  are  not  implementable  in  their  full  generality.  For  example,  if  unimg  were 
applicable  to  all  computable  functions,  it  would  be  possible  to  solve  the  halting  prob¬ 
lem,  since 

Halts(/  ,x)  unimg/x  *  0 

Since  the  halting  problem  is  not  solvable,  we  cannot  implement  unimg  and  the  other 
operators  used  in  the  definition  of  Halts  so  that  they  works  on  all  computable  func¬ 
tions.  Similar  arguments  set  bounds  on  the  implementability  of  many  of  the  other 
operators. 

These  limitations  do  not  prevent  the  use  of  the  relational  operators  as  a 
specification  language.  For  this  purpose  it  is  only  necessary  that  relational  programs 
precisely  specify  the  relationships  between  inputs  and  outputs,  not  that  the  programs 
be  implementable.  However,  if  we  wish  to  use  the  relational  operators  for  executable 
specifications  or  for  a  full-fledged  programming  language,  then  the  issue  of  implemen¬ 
tability  becomes  important, 

19.3  ertemrtonal  representation 

It  should  be  clear  that  all  the  operators  are  implementable  on  extensionally 
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represented  sets  and  relations,  that  is,  on  sets  and  relations  whose  elements  are  expli¬ 
citly  listed  in  some  form  in  the  computer's  memory.  Obviously,  only  finite  sets  and 
relations  can  be  represented  extensionally,  Suha  Futaci  [FutaciB2]  has  analyzed  the 
complexity  of  the  algorithms  associated  with  several  different  extensional  representa¬ 
tions. 

19.4  intensional  representations 

Infinite  sets  and  relations  must  be  represented  intensionally,  that  is,  without  expli¬ 
citly  listing  their  elements.  There  are  several  ways  of  accomplishing  this.  For  exam¬ 
ple,  infinite  sets  can  be  represented  by  their  characteristic  functions:  total,  comput¬ 
able,  Boolean-valued  functions  that  determine  whether  or  not  a  given  element  is  in  the 
set.  Since  we  require  these  functions  to  be  computable  they  can  be  expressed  in  a 
finite  algorithm  and  so  are  finitely  reresentable  in  the  computer’s  memory3. 

Another  intensional  representation  of  infinite  sets  makes  use  of  computable 
enumeration.  functions.  It  f  is  an  enumeration  function  for  a  set  then  /( 1),  /( 2),  ... 
are  distinct  elements  of  the  set.  If  n  is  greater  than  the  cardinality  of  the  set,  then 
/  (tl)  might  not  halt. 

One  of  the  most  common  intensional  representations  of  infinite  relations  makes  use 
of  the  corresponding  computable  function.  That  is,  the  computable  function  /  can  be 
used  to  represent  the  relation  R  when  y-f  (z)  o  (x  \y)^R .  Clearly,  this  representa¬ 
tion  can  be  used  only  when  R  is  right  univalent.  Also,  if  x  £  dom /  then  the  computa¬ 
tion  of  /  (x)  might  not  halt. 

19.5  eliminating  polymorphism 

When  we  investigate  each  of  the  various  extensional  and  intensional  representations 
of  sets  and  relations,  we  find  that  different  combinations  of  the  operators  are  imple- 
mentable  on  each  representation.  This  could  lead  to  a  very  confusing  situation  for  the 

3.  Of  course,  computable  characteristic  functions  only  allow  (by  definition)  the  representetion  of  recursive 

sets.  There  is  little  to  be  lost  in  restricting  our  attention  to  recursive  set3,  however. 
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TAB1Z  1.  Sets  Represented  by  their  Characteristic  Functions 
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relational  programmer.  Without  consulting  a  table  of  some  kind  the  programmer 
would  never  be  sure  whether  or  not  a  particular  combination  was  implementable. 
Therefore,  relational  programming  will  be  simplified  if  we  can  divide  the  operators  into 
disjoint  classes  in  such  a  way  that  each  operator  is  applicable  and  implementable  on 
exactly  one  representation.  Fortunately,  when  we  investigate  the  use  of  the  relational 


operators  we  find  that  certain  operators  are  mostly  used  on  finite  sets  and  relations 
and  others  are  mostly  used  on  computable  functions.  Thus  we  have  a  basis  for  a  divi¬ 
sion  of  the  operators. 


To  accomplish  this  goal  it  is  necessary  to  eliminate  any  polymorphism,  that  is,  any 
operators  that  are  both  implementable  and  useful  on  more  than  one  representation. 
For  example,  the  set  operations  (n,  u,  \,  etc.)  are  useful  and  implementable  on  both 
finite  sets  and  infinite  sets  represented  by  characteristic  functions.  However,  the  set 
operations  on  infinite  sets  are  easily  expressed  as  abstractions  and  compositions  of  the 
Boolean  operations  applied  to  the  corresponding  characteristic  functions;  see  Table  1. 
The  simplicity  and  directness  of  this  representation  of  infinite  sets  and  :  heir  operators 
permits  us  to  eliminate  them  as  basic  objects  in  relational  programming.  Thus,  the  set 
operations  (n,  u,  \,  etc.)  will  only  be  allowed  on  finite  sets  and  relations. 
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Since  we  have  eliminated  characteristic  functions  as  built-in  representations  of 
infinite  sets  and  relations,  we  are  left  with  only  two  others:  enumeration  functions  and 
computable  functions  (for  right  univalent  relations).  We  have  chosen  to  eliminate 
enumeration  functions  because  they  have  few  uses  and  these  can  be  easily  expressed 
using  the  functional  operations. 

This  leaves  us  with  two  classes  of  objects  in  relational  programming: 

•  Finite  sets  (and  hence  relations) 

•  Computable  functions 

There  are  only  a  few  operations  that  are  both  useful  and  implementable  on  both  of 
these  classes.  For  example,  the  application  operation  can  be  used  both  for  applying  a 
computable  function  to  its  argument  and  for  looking  up  an  item  in  a  table  (a  finite  rela¬ 
tion).  Therefore  we  define  two  versions  of  this  operation:  /@x,  which  applies  the  com¬ 
putable  function  /  to  x,  and  tix  (suggesting  subscripting),  which  applies  the  finite 
relation  (table)  t  to  x.  We  allow  f@x  to  be  abbreviated  fx  and  fix  to  be  abbreviated 
*«• 

For  some  of  the  polymorphic  operations  either  the  intensional  version  or  the  exten- 
sional  version  can  be  easily  expressed  in  terms  of  other  operations.  In  these  cases  the 
easily  expressible  version  can  be  dropped  with  little  loss  of  convenience.  An  example  of 
this  is  img.inv/p,  where  /  is  a  total  function  and  p  is  a  characteristic  function.  This 
can  be  written p./  since  p./  is  the  characteristic  function  of  img.inv/p. 

19.8  extunsianal  operators 

The  results  of  the  separation  process  are  displayed  in  Tables  2-5.  Table  2  lists  the 
primitive  operations  on  finite,  extensionally  represented  sets  and  relations.  These 
operations  are  considered  primitive  because  they  are  not  simply  defined  in  terms  of 
other  operations.  Tables  3  and  4  show  the  non-primitive  operations  on  extensionally 
represented  sets  and  relations,  that  is,  those  that  can  be  simply  defined  in  te?'ms  of 
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TABLE  2.  Primitive  Extensional  Operations 


tlx 

application 

t  \u 

relative  product 

t~u 

construction 

x.y 

pair  formation 

sut 

union 

uni 

unit-set  formation 

cur  t 

Currying 

unc  t 

un-Currying 

unique  element  selection 

sizes 

cardinality 

strf 

structure  of  relation 

t* 

transitive  closure 

TABIE  3.  Non-primitive  Extensional  Operations  (Part  1) 


other  operations.  Although  these  operations  are  non-primitive,  we  would  expect  that 
they  would  be  built-in  in  a  relational  programming  system.  These  definitions  make  use 
of  several  new  primitive  operations,  which  are  defined  in  Table  5.  They  also  make  use 
of  the  operations  on  elementary  pairs:  Hd  =  ot.un  and  Tl  =  w.un. 
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TABUS  4.  Non-primitive  Extensional  Operations  (Part  2) 
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rpi ft 
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t  u  rpi[+size.dom  f]u 
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img  Ssxs 
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size. inv.all. rsort  s 

unimgfx 

rng[unz  -*  t  ] 

unimgf 

img/  (domf)  where  fx  =  x:(unimgfx) 

ssm 

unc.sa.sa5 

19.7  interatanal  apemtm 

All  the  intensionai  operators  can  be  expressed  using  recursive  definitions  and 
Lambda  expressions.  Nevertheless,  it  is  useful  to  divide  these  operators  into  two 
classes,  primitive  and  non-primitive,  on  the  basis  of  whether  they  can  be  easily  defined 
in  terms  of  the  other  operators.  The  intensionai  operators  are  shown  in  Tables  6  and  7. 


20.  Condosiona 

Of  course,  we  are  not  the  first  to  propose  introducing  aspects  of  a  relational  calculus 
into  programming.  Codd  [Codd70]  has  used  a  relational  calculus  as  the  basis  for  data 
base  systems.  Although  he  defines  several  operations  on  relations  (viz.,  permutation, 
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and  j  true}  =  true 
andjfalse}  =  false 
andjtrue, false}  =  false 

or  {true}  =  true 
orjfalsej  =  false 
or{  true,  false}  =  true 

unionjS^Sg,  .  .  .  ,5n{  = 

SiUSzu  ■ 

fz}f  (a  finite  setl 

TAB1£  8.  Primitive  Intensional  Operations 


/@z 
img/s 

(/•ff)* 
zrr 

JTZ 

(/  Ito)* 

fjt 

(/•s)* 

curry/  [J 
uncurry f  f 
$p(d,r)  (£ 


■isasri 


TABLE  7.  Non-primitive  Intensional  Operations 


while[p ,/  ]  p  -*  iter[p  -»/  ];  Id 

/ §£  while[0?e.u,  (/.  [Id||a]  ||  0.a>).A].(i,) 

/n  while[n*.a,  l+||/]  (0,) 

vf  @.[Id|/] 

<p  Id| 

6  ||Id 

n /  6[f,  ] 

extend(f,/)  edom 
restricts ,/ )  img[i5  .  Id||/  .  A]s 


join,  tie,  composition,  and  restriction),  this  small  set  of  operations  is  insufficient  for 
general  purpose  programming.  These  remarks  also  apply  to  Childs'  reconstituted 
definition  of  relations  [Childs69],  which  is  also  oriented  towards  data  bases.  Feldman 
and  Rovner  [Feldman69]  augmented  Algol  with  several  relational  operators  for  associa¬ 
tive  access  to  a  data  base.  Their  operations,  which  are  our  plural  description  and 
image,  are  quite  limited,  being  based  on  a  traditional  von  Neumann  language. 
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One  general  purpose  language  that  does  make  extensive  use  of  sets  and  relations  is 
SETL  [Kennedy75].  It  provides  most  of  the  familiar  operations  on  sets  (e.g.,  union, 
intersection,  difference,  powerset,  image).  SETL  differs  from  relational  programming 
in  three  significant  respects:  (l)  it  can  only  handle  finite  sets,  (2)  many  operations 
must  still  be  performed  in  a  word-at-a-time  fashion  using  the  set  former,  and  (3)  it 
resorts  to  conventional  control  structures. 

Finally,  we  must  mention  logic  programming  systems,  such  as  PROLOG  [Kowalski79. 
vanEmden76],  which  use  predicate  logic  to  describe  computational  processes.  These 
systems  also  differ  from  relational  programming  in  two  significant  respects:  (1)  they 
have  a  word-at-a-time  programming  style  due  to  the  use  of  variables  representing  indi¬ 
viduals  in  the  clauses  of  the  program,  and  (2)  they  are  implemented  using  a  resolution 
theorem  prover,  whereas  a  more  conventional  procedural  implementation  suffices  for 
relational  programming.  Essentially  the  same  remarks  apply  to  Popplestone's  lela- 
tional  programming  [Popplestone79],  which  is  like  logic  programming  except  that  it 
uses  "forward  inference"  rather  than  "backward  inference." 

In  summary,  no  other  programming  style  that  we  are  aware  of  combines  the  univer¬ 
sal  use  of  relations  with  a  rich  set  of  operations  on  those  relations  that  can  be  imple¬ 
mented  in  a  deterministic,  procedural  way.  It  is  hoped  that  the  preceeding  discussion 
has  made  plausible  some  of  the  advantages  claimed  for  relational  programming  in  the 
Introduction.  Considerable  work  remains  to  be  done  in  evaluating  the  effectiveness  cf 
a  relational  calculus  as  a  programming  tool.  For  instance,  the  optimum  set  of  combi- 
nators  and  relational  operators  must  be  selected.  Another  non-trivial  problem  is  the 
selection  of  a  good  notation  for  the  relational  calculus.  More  from  convenience  than 
conviction  we  have  based  our  notation  on  [White head70]  and  [Carnap58],  Making  rela¬ 
tional  programming  an  effective  tool  will  require  designing  a  notation  that  combines 
readability  with  the  manipulative  advantages  of  a  two-dimensional  algebraic  notation. 
This  is  all  preliminary  to  any  serious  considerations  of  software  or  hardware  implemen¬ 
tation  techniques. 
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